00000001:02000400:2.0F:1785219612.599582:0:2962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1785219632.038396:0:3183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1785219634.078291:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 673 MB/s 00000001:01000000:2.0:1785219634.329146:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 581 MB/s 00000001:01000000:0.0:1785219634.578462:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4587 MB/s 00000020:02000000:2.0:1785219635.228622:0:3275:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_204_g5db9db4 00000400:02000000:2.0:1785219636.094712:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.131@tcp [8/256/0/180] 00008000:02000000:1.0:1785219639.827405:0:3440:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1785219692.317350:0:5246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1785219702.070632:0:5774:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785219702.070643:0:5774:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1785219702.070782:0:5774:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000006651819a 00000080:02000400:3.0:1785219702.070793:0:5774:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1785219702.076897:0:5774:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1785219702.076911:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785219702.076949:0:5774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000c323824) 00000020:00000080:3.0:1785219702.076970:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1785219702.095030:0:5774:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1785219702.095665:0:5774:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1785219702.125865:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1785219702.125906:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785219702.125925:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1785219702.125974:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785219702.125999:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1785219702.126772:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1785219702.126781:0:5774:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1785219702.126794:0:5774:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078c436 00000020:01000004:2.0:1785219702.126802:0:5774:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1785219702.126807:0:5774:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1785219702.126811:0:5774:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006651819a from MGS 00000020:01000004:2.0:1785219702.126815:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1785219702.126832:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000062c4b1a4) 00000020:00000080:2.0:1785219702.126846:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1785219702.126958:0:5774:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006651819a from MGS, refs=2 00080000:01000000:2.0:1785219702.126964:0:5774:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785219702.126969:0:5774:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078c444 00000100:00100000:2.0:1785219702.127072:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1785219702.127429:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1785219702.127437:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1785219702.128187:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1785219702.128194:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1785219702.129687:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785219702.129845:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1785219702.129851:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1785219702.130848:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1785219702.130856:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1785219702.131314:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1785219702.131628:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1785219702.132700:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219702.132705:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219702.132706:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219702.133058:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219702.133061:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219702.133062:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219702.134105:0:5774:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1785219702.140528:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1785219702.384274:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2635 MB/s 00000001:01000000:2.0:1785219702.636084:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2615 MB/s 00000001:01000000:3.0:1785219702.885665:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 379 MB/s 00000001:01000000:1.0:1785219703.135952:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 851 MB/s 00010000:00010000:0.0:1785219703.162203:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1785219703.162231:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1785219703.189996:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1785219703.190011:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1785219703.190014:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1785219703.190715:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1785219703.190769:0:5774:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1785219703.190811:0:5774:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1785219703.190964:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1785219703.190988:0:5774:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1785219703.191334:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785219703.191630:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1785219703.191637:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1785219703.198408:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1785219703.198424:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1785219703.198906:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1785219703.198912:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1785219703.199547:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1785219703.199566:0:5774:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:2.0:1785219703.199568:0:5774:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1785219703.199606:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:2.0:1785219703.199617:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (00000000a3349bb8) 00000020:00000080:2.0:1785219703.199633:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1785219703.199738:0:5774:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006f4eff7f@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1785219703.199906:0:5774:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:2.0:1785219703.199913:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 00000100:00080000:3.0:1785219703.200697:0:5789:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1785219703.209811:0:5790:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1785219703.209893:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 6828c272-120a-44fd-b7c4-fcf074b0473f) 00000020:00000080:0.0:1785219703.209918:0:5774:0:(genops.c:1406:class_connect()) connect: client 6828c272-120a-44fd-b7c4-fcf074b0473f, cookie 0x8b38d407a078c452 00000100:00080000:0.0:1785219703.209931:0:5774:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785219703.209936:0:5774:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import 000000006f4eff7f using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219703.209980:0:5774:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002c1041b4 x1871938465038464/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785219703.210005:0:5774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6828c272-120a-44fd-b7c4-fcf074b0473f->MGS 00000020:01000004:0.0:1785219703.210027:0:5774:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1785219703.210033:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1785219703.210051:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000065b90db6) 00000020:00000080:0.0:1785219703.210063:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1785219703.210579:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c1041b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6828c272-120a-44fd-b7c4-fcf074b0473f:3305:1871938465038464:0@lo:250: 00000100:00100000:1.0:1785219703.210673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219703.210737:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465038464 00000100:00100000:1.0:1785219703.210744:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465038464 00000100:00100000:1.0:1785219703.210789:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219703.210795:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce69ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1871938465038464:12345-0@lo:250: 00010000:00080000:1.0:1785219703.210814:0:5785:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6828c272-120a-44fd-b7c4-fcf074b0473f@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1785219703.210834:0:5785:0:(genops.c:1406:class_connect()) connect: client 6828c272-120a-44fd-b7c4-fcf074b0473f, cookie 0x8b38d407a078c460 00000100:00080000:1.0:1785219703.210948:0:5785:0:(import.c:65:import_set_state_nolock()) 00000000a1a28729 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219703.210997:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce69ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+5:3305:x1871938465038464:12345-0@lo:250: Request processed in 202us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219703.211004:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219703.211037:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1785219703.211044:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:1.0:1785219703.211057:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1785219703.211062:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1785219703.211064:0:3305:0:(import.c:65:import_set_state_nolock()) 000000006f4eff7f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1785219703.211067:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1785219703.211073:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1785219703.211077:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c1041b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6828c272-120a-44fd-b7c4-fcf074b0473f:3305:1871938465038464:0@lo:250: 00000100:00100000:1.0:1785219703.221537:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219703.221706:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1785219703.221712:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1785219703.228000:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1785219703.228014:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1785219703.228580:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1785219703.228588:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1785219703.229587:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219703.230088:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1785219703.230095:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1785219703.230833:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1785219703.230842:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1785219703.273169:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219703.273810:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1785219703.273817:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1785219703.275053:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1785219703.275063:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1785219703.276081:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219703.276251:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1785219703.276256:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1785219703.276998:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1785219703.277005:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1785219703.277868:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219703.278012:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1785219703.278017:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1785219703.278897:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1785219703.278905:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1785219703.279858:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219703.280004:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1785219703.280009:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1785219703.280699:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1785219703.280707:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1785219703.320656:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219703.320866:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1785219703.320873:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1785219703.334344:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1785219703.334646:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1785219703.336341:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785219703.336356:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1785219703.342008:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1785219703.342035:0:5774:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1785219703.342041:0:5774:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1785219703.342172:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1785219703.342206:0:5774:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1785219703.342211:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1785219703.342212:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785219703.342213:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219703.342214:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219703.342215:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219703.342216:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219703.342217:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785219703.342219:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785219703.342220:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219703.342222:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219703.342223:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219703.342229:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219703.342232:0:5774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1785219703.342234:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785219703.342235:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785219703.342235:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219703.342236:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219703.342237:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219703.342238:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219703.342239:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785219703.342239:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785219703.342240:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219703.342241:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219703.342242:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219703.342243:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219703.342291:0:5774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1785219703.342308:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b714f28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038592:0@lo:253: 00000100:00100000:3.0:1785219703.342423:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219703.342481:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000005207e051 going to sleep for 11 seconds 00000100:00100000:2.0:1785219703.342670:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465038592 00000100:00100000:2.0:1785219703.342677:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465038592 00000100:00100000:2.0:1785219703.342714:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219703.342721:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb4afa0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+5:5774:x1871938465038592:12345-0@lo:253: 20000000:01000000:2.0:1785219703.342765:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1785219703.342768:0:5788:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1785219703.343171:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1785219703.343228:0:5788:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1785219703.343696:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785219703.345160:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1785219703.345686:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1785219703.345691:0:5788:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1785219703.345696:0:5788:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1785219703.345699:0:5788:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1785219703.345716:0:5788:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1785219703.345996:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785219703.346212:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1785219703.346225:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1785219703.346349:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1785219703.347624:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1785219703.347679:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1785219703.347834:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1785219703.347845:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1785219703.347896:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1785219703.347905:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1785219703.347939:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1785219703.347947:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1785219703.347981:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1785219703.348048:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1785219703.348085:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1785219703.348091:0:5788:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1785219703.348130:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785219703.348916:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1785219703.348934:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1785219703.348979:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1785219703.349016:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1785219703.349081:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1785219703.349098:0:5788:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1785219703.349205:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1785219703.349214:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1785219703.350314:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1785219703.350424:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1785219703.350605:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1785219703.350621:0:5788:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1785219703.350746:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1785219703.350756:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1785219703.350791:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1785219703.350829:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1785219703.351004:0:5788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1785219703.351054:0:5788:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1785219703.351061:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1785219703.351747:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1785219703.352015:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1785219703.352040:0:5788:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.131@tcp for mdt 20000000:01000000:2.0:1785219703.352042:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:2.0:1785219703.352080:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1785219703.352088:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1785219703.352145:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1785219703.352154:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:2.0:1785219703.352204:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1785219703.352215:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1785219703.352328:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1785219703.352514:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1785219703.352586:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1785219703.352590:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1785219703.352596:0:5788:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1785219703.352602:0:5788:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1785219703.356150:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1785219703.356609:0:5788:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1785219703.366247:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1785219703.366632:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1785219703.366753:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1785219703.366773:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1785219703.366775:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1785219703.366779:0:5788:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1785219703.366791:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785219703.366793:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1785219703.366824:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1785219703.366826:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1785219703.373562:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1785219703.374038:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1785219703.374089:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1785219703.374214:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1785219703.374230:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1785219703.374232:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1785219703.374903:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1785219703.375154:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1785219703.375196:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1785219703.375231:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1785219703.375245:0:5788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785219703.375248:0:5788:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1785219703.375255:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1785219703.375349:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380144:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380165:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380170:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380176:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380182:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380188:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e24becfa already unused, calling callback (000000002ca9618a) 00010000:00010000:0.0:1785219703.380191:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380198:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380209:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380215:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.380219:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e24becfa/0x8b38d407a078c467 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1785219703.380260:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1785219703.632098:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb4afa0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+5:5774:x1871938465038592:12345-0@lo:253: Request processed in 289367us (289666us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219703.632127:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785219703.632222:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b714f28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038592:0@lo:253: 10000000:01000000:3.0:1785219703.632238:0:5774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1785219703.632241:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785219703.632243:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785219703.632244:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219703.632246:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1785219703.632247:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219703.632248:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219703.632250:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785219703.632251:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785219703.632252:0:5774:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1785219703.632254:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219703.632255:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1785219703.632342:0:5774:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006651819a from lustre-MDT0000 10000000:01000000:3.0:1785219703.632538:0:5774:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1785219703.632542:0:5774:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1785219703.632555:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cf3486699c0 10000000:01000000:3.0:1785219703.632559:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785219703.632567:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf3486699c0 from 1 10000000:01000000:3.0:1785219703.632570:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1785219703.632608:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.632618:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.632625:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219703.632642:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b714f28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038720:0@lo:101: 00000100:00100000:3.0:1785219703.632679:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219703.632809:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dab5680c going to sleep for 11 seconds 00000100:00100000:0.0:1785219703.632886:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465038720 00000100:00100000:0.0:1785219703.632894:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465038720 00000100:00100000:0.0:1785219703.633022:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785219703.633031:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a308ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:5774:x1871938465038720:12345-0@lo:101: 00010000:00010000:0.0:1785219703.633045:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219703.633058:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c46e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.633079:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c46e expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.633089:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c46e expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219703.633099:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e24becfa, rc 0) 00000100:00100000:0.0:1785219703.633150:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a308ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+6:5774:x1871938465038720:12345-0@lo:101: Request processed in 121us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219703.633157:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219703.633224:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b714f28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038720:0@lo:101: 00010000:00010000:1.0:1785219703.633237:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.633244:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219703.633316:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038848:0@lo:501: 00000100:00100000:1.0:1785219703.633341:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219703.633733:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ca48f63 going to sleep for 11 seconds 00000100:00100000:3.0:1785219703.633809:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465038848 00000100:00100000:3.0:1785219703.633815:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465038848 00000100:00100000:3.0:1785219703.633839:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219703.633844:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d9f3e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+6:5774:x1871938465038848:12345-0@lo:501: 00000100:00100000:3.0:1785219703.634088:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d9f3e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+6:5774:x1871938465038848:12345-0@lo:501: Request processed in 242us (746us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785219703.634096:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785219703.634187:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038848:0@lo:501: 10000000:01000000:1.0:1785219703.634215:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785219703.634235:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.634255:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219703.634273:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf3503a5000 10000000:01000000:1.0:1785219703.634278:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785219703.634282:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cf3503a5000 10000000:01000000:1.0:1785219703.634284:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1785219703.634288:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9cf3503a5000 from 1 10000000:01000000:1.0:1785219703.634290:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1785219703.634314:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000008d220ed6/0x8b38d407a078c47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.634321:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000008d220ed6/0x8b38d407a078c47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.634328:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000008d220ed6/0x8b38d407a078c47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219703.634340:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038976:0@lo:101: 00000100:00100000:1.0:1785219703.634395:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219703.634412:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ca48f63 going to sleep for 11 seconds 00000100:00100000:3.0:1785219703.634643:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465038976 00000100:00100000:3.0:1785219703.634648:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465038976 00000100:00100000:3.0:1785219703.634667:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785219703.634673:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004257dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+6:5774:x1871938465038976:12345-0@lo:101: 00010000:00010000:3.0:1785219703.634681:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219703.634692:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5532fca/0x8b38d407a078c483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c47c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.634715:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5532fca/0x8b38d407a078c483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c47c expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.634724:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5532fca/0x8b38d407a078c483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c47c expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.634732:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5532fca, rc 0) 00000100:00100000:3.0:1785219703.634770:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004257dfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+7:5774:x1871938465038976:12345-0@lo:101: Request processed in 97us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219703.634776:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785219703.634848:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465038976:0@lo:101: 00010000:00010000:1.0:1785219703.634860:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000008d220ed6/0x8b38d407a078c47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.634868:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000008d220ed6/0x8b38d407a078c47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219703.634894:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1785219703.634908:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000008d220ed6/0x8b38d407a078c47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.634914:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000008d220ed6/0x8b38d407a078c47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219703.634921:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1785219703.634925:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785219703.634930:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cf3503a5000 10000000:01000000:1.0:1785219703.634932:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1785219703.634935:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1785219703.634937:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1785219703.634951:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.634957:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.634963:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219703.634975:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039104:0@lo:101: 00000100:00100000:1.0:1785219703.634999:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219703.635010:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ca48f63 going to sleep for 11 seconds 00000100:00100000:3.0:1785219703.635068:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465039104 00000100:00100000:3.0:1785219703.635073:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465039104 00000100:00100000:3.0:1785219703.635090:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785219703.635095:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b249ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+7:5774:x1871938465039104:12345-0@lo:101: 00010000:00010000:3.0:1785219703.635113:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219703.635120:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c48a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.635133:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c48a expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.635140:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c48a expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219703.635147:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2ebdc28, rc 0) 00000100:00100000:3.0:1785219703.635181:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b249ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+8:5774:x1871938465039104:12345-0@lo:101: Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219703.635187:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785219703.635325:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039104:0@lo:101: 00010000:00010000:1.0:1785219703.635335:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219703.635353:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219703.635561:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039232:0@lo:501: 00000100:00100000:1.0:1785219703.635585:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219703.635601:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ca48f63 going to sleep for 11 seconds 00000100:00100000:3.0:1785219703.635655:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465039232 00000100:00100000:3.0:1785219703.635660:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465039232 00000100:00100000:3.0:1785219703.635677:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785219703.635682:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b006260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+8:5774:x1871938465039232:12345-0@lo:501: 00000100:00100000:3.0:1785219703.635888:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b006260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5774:x1871938465039232:12345-0@lo:501: Request processed in 206us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219703.635896:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785219703.635969:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039232:0@lo:501: 00000100:00100000:1.0:1785219703.635993:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039360:0@lo:503: 00000100:00100000:1.0:1785219703.636027:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219703.636047:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ca48f63 going to sleep for 11 seconds 00000100:00100000:0.0:1785219703.636114:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465039360 00000100:00100000:0.0:1785219703.636119:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465039360 00000100:00100000:0.0:1785219703.636146:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219703.636151:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f870312a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5774:x1871938465039360:12345-0@lo:503: 00000100:00100000:0.0:1785219703.636534:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f870312a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5774:x1871938465039360:12345-0@lo:503: Request processed in 382us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219703.636541:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785219703.636666:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039360:0@lo:503: 00000100:00100000:1.0:1785219703.637014:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5817:1871938465039488:0@lo:502: 00000100:00100000:1.0:1785219703.637051:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219703.637082:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b15a3fc2 going to sleep for 11 seconds 00000100:00100000:2.0:1785219703.637148:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465039488 00000100:00100000:2.0:1785219703.637154:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465039488 00000100:00100000:2.0:1785219703.637193:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785219703.637199:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b52247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5817:x1871938465039488:12345-0@lo:502: 00000100:00100000:2.0:1785219703.637698:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b52247 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5817:x1871938465039488:12345-0@lo:502: Request processed in 499us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219703.637713:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785219703.637834:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5817:1871938465039488:0@lo:502: 00000020:01000000:1.0:1785219703.637860:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219703.637870:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219703.637872:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785219703.637878:0:5817:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1785219703.637881:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785219703.637903:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b58334c8) 00000020:00000080:1.0:1785219703.637923:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1785219703.637930:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1785219703.638013:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1785219703.638020:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078c49f 00000020:00000080:1.0:1785219703.638247:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1785219703.638257:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219703.638336:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219703.638338:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785219703.638342:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219703.638346:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219703.638347:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1785219703.638350:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785219703.638357:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ca38c527) 00000020:00000080:1.0:1785219703.638544:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1785219703.638550:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1785219703.638551:0:5817:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1785219703.638554:0:5817:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1785219703.638559:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1785219703.638609:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006651819a from lustre-MDT0000, refs=3 00000020:00000080:1.0:1785219703.638621:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000411b6bb) 00000020:00000080:1.0:1785219703.638629:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1785219703.638677:0:5817:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1785219703.638682:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078c4b4 00000020:00000080:1.0:1785219703.638770:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1785219703.638776:0:5817:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1785219703.638780:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8b38d407a078c4bb 00080000:01000000:1.0:1785219703.638784:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1785219703.638787:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078c4c2 00080000:10000000:1.0:1785219703.639569:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1785219703.639778:0:5817:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1785219703.653808:0:5817:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1785219703.745549:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1785219703.745857:0:5817:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1785219703.752927:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1785219703.753262:0:5817:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1785219703.825854:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b1f3825d) 00000020:00000080:1.0:1785219703.825877:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1785219703.825955:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1785219703.825960:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078c4d0 00000020:00000080:1.0:1785219703.827049:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1785219703.832848:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785219703.891907:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219703.936069:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1785219703.991922:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1785219704.037834:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1785219704.090859:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1785219704.151127:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8b38d407a078c4d7 00000020:00000080:1.0:1785219704.155951:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1785219704.155965:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219704.155974:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219704.155976:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1785219704.155979:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219704.155986:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219704.155987:0:5817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1785219704.155991:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1785219704.156038:0:5817:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1785219704.156055:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219704.156058:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219704.156059:0:5817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1785219704.156061:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219704.156064:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219704.156065:0:5817:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1785219704.156068:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1785219704.156070:0:5817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1785219704.156125:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5817:1871938465039616:0@lo:502: 00000100:00100000:1.0:1785219704.156223:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219704.156295:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e9c6c2a going to sleep for 11 seconds 00000100:00100000:0.0:1785219704.156810:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465039616 00000100:00100000:0.0:1785219704.156818:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465039616 00000100:00100000:0.0:1785219704.156872:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785219704.156879:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f30118ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5817:x1871938465039616:12345-0@lo:502: 00000100:00100000:0.0:1785219704.157992:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f30118ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5817:x1871938465039616:12345-0@lo:502: Request processed in 1109us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219704.158006:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785219704.158146:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003300e98c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5817:1871938465039616:0@lo:502: 00000020:01000000:2.0:1785219704.158180:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219704.158188:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219704.158190:0:5817:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1785219704.158195:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1785219704.158295:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1785219704.158321:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785219704.158341:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219704.158353:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219704.158383:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf3503a5000 from 1 10000000:01000000:1.0:1785219704.158387:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785219704.158442:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219704.158464:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219704.158473:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219704.158491:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068086471 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039744:0@lo:101: 00000100:00100000:1.0:1785219704.158718:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219704.158759:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465039744 00000100:00100000:1.0:1785219704.158763:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0d0b12b going to sleep for 11 seconds 00000100:00100000:2.0:1785219704.158766:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465039744 00000100:00100000:2.0:1785219704.158799:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785219704.158806:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9aaf8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+9:5774:x1871938465039744:12345-0@lo:101: 00010000:00010000:2.0:1785219704.158816:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219704.158841:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c4de expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.158861:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c4de expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.158871:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c4de expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.158879:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f977fb2, rc 0) 00000100:00100000:2.0:1785219704.158934:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9aaf8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+10:5774:x1871938465039744:12345-0@lo:101: Request processed in 128us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219704.158941:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785219704.159090:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068086471 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039744:0@lo:101: 00010000:00010000:1.0:1785219704.159113:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219704.159122:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219704.160098:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068086471 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039872:0@lo:256: 00000100:00100000:1.0:1785219704.160797:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219704.160885:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0d0b12b going to sleep for 11 seconds 00000100:00100000:0.0:1785219704.160942:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465039872 00000100:00100000:0.0:1785219704.160950:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465039872 00000100:00100000:0.0:1785219704.161023:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785219704.161030:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000156c29a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+10:5774:x1871938465039872:12345-0@lo:256: 20000000:01000000:0.0:1785219704.161048:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1785219704.161053:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1785219704.161204:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000156c29a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+10:5774:x1871938465039872:12345-0@lo:256: Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219704.161211:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785219704.161279:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068086471 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465039872:0@lo:256: 10000000:01000000:3.0:1785219704.162179:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1785219704.162201:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.162212:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219704.162220:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf3503a5000 from 1 10000000:01000000:3.0:1785219704.162223:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785219704.162255:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.162262:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.162269:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219704.162310:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000115d20d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040000:0@lo:101: 00000100:00100000:3.0:1785219704.162351:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219704.162907:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dab5680c going to sleep for 11 seconds 00000100:00100000:1.0:1785219704.162954:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040000 00000100:00100000:1.0:1785219704.162961:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040000 00000100:00100000:1.0:1785219704.163006:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785219704.163015:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030f36a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+10:5774:x1871938465040000:12345-0@lo:101: 00010000:00010000:1.0:1785219704.163028:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219704.163044:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c4ec expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219704.163081:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219704.163091:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219704.163111:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000965b4ce1, rc 0) 00000100:00100000:1.0:1785219704.163168:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030f36a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5774:x1871938465040000:12345-0@lo:101: Request processed in 156us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219704.163175:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785219704.163254:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000115d20d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040000:0@lo:101: 00010000:00010000:3.0:1785219704.163268:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.163275:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219704.163344:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000115d20d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040128:0@lo:501: 00000100:00100000:3.0:1785219704.163398:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219704.163418:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dab5680c going to sleep for 11 seconds 00000100:00100000:0.0:1785219704.163866:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040128 00000100:00100000:0.0:1785219704.163872:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040128 00000100:00100000:1.0:1785219704.163997:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785219704.164004:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c19f0342 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5774:x1871938465040128:12345-0@lo:501: 00000100:00100000:1.0:1785219704.165038:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c19f0342 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5774:x1871938465040128:12345-0@lo:501: Request processed in 1031us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219704.165048:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219704.165487:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000115d20d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040128:0@lo:501: 00000100:00100000:0.0:1785219704.165726:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b02c81b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040256:0@lo:503: 00000100:00100000:0.0:1785219704.165781:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219704.165818:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5af1b24 going to sleep for 11 seconds 00000100:00100000:3.0:1785219704.165874:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040256 00000100:00100000:3.0:1785219704.165881:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040256 00000100:00100000:3.0:1785219704.165913:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785219704.165919:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5200d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5774:x1871938465040256:12345-0@lo:503: 00000040:00080000:3.0:1785219704.165959:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785219704.166012:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5200d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5774:x1871938465040256:12345-0@lo:503: Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219704.166019:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219704.166183:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b02c81b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040256:0@lo:503: 00000040:00080000:0.0:1785219704.167850:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1785219704.168194:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1785219704.168216:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219704.168241:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.168253:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219704.168453:0:5774:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785219704.168867:0:5774:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf3503a5000 10000000:01000000:3.0:1785219704.168871:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf3503a5000 10000000:01000000:3.0:1785219704.168877:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785219704.168884:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf3503a5000 from 1 10000000:01000000:3.0:1785219704.168887:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785219704.168924:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.168933:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.168942:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219704.168964:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001fd1010c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040384:0@lo:101: 00000100:00100000:3.0:1785219704.169027:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219704.169067:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091cc6406 going to sleep for 11 seconds 00000100:00100000:3.0:1785219704.169092:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040384 00000100:00100000:3.0:1785219704.169115:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040384 00000100:00100000:2.0:1785219704.169170:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785219704.169182:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081162d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5774:x1871938465040384:12345-0@lo:101: 00010000:00010000:2.0:1785219704.169197:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219704.169217:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c4fa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.169250:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.169260:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.169268:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006d818fb, rc 0) 00000100:00100000:2.0:1785219704.169319:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081162d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5774:x1871938465040384:12345-0@lo:101: Request processed in 141us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219704.169385:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001fd1010c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040384:0@lo:101: 00010000:00010000:0.0:1785219704.169401:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.169409:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219704.169481:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b02c81b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040512:0@lo:501: 00000100:00100000:0.0:1785219704.169509:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219704.169715:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000384fe843 going to sleep for 11 seconds 00000100:00100000:1.0:1785219704.170255:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040512 00000100:00100000:1.0:1785219704.170261:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040512 00000100:00100000:2.0:1785219704.171818:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785219704.171878:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785219704.171890:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a57d9bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5774:x1871938465040512:12345-0@lo:501: 00000100:00100000:2.0:1785219704.172235:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a57d9bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5774:x1871938465040512:12345-0@lo:501: Request processed in 349us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219704.172245:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785219704.172273:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b02c81b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040512:0@lo:501: 00010000:00010000:1.0:1785219704.172358:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219704.172715:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b02c81b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040640:0@lo:503: 00000100:00100000:0.0:1785219704.172769:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219704.172810:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000384fe843 going to sleep for 11 seconds 00000100:00100000:3.0:1785219704.172862:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040640 00000100:00100000:3.0:1785219704.172869:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040640 00000100:00100000:3.0:1785219704.172907:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785219704.172914:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038473705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5774:x1871938465040640:12345-0@lo:503: 00000100:00100000:3.0:1785219704.173326:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038473705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5774:x1871938465040640:12345-0@lo:503: Request processed in 408us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219704.173333:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785219704.178041:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b02c81b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465040640:0@lo:503: 00000100:00100000:2.0:1785219704.178851:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4279c1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5822:1871938465040768:0@lo:502: 00000100:00100000:2.0:1785219704.178916:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219704.178961:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 0000000071d864ca going to sleep for 11 seconds 00000100:00100000:3.0:1785219704.179128:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040768 00000100:00100000:3.0:1785219704.179150:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040768 00000100:00100000:3.0:1785219704.179198:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785219704.179207:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066934261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5822:x1871938465040768:12345-0@lo:502: 00000100:00100000:2.0:1785219704.179871:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066934261 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5822:x1871938465040768:12345-0@lo:502: Request processed in 664us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219704.179881:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785219704.179959:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4279c1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5822:1871938465040768:0@lo:502: 00000020:01000004:3.0:1785219704.180018:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1785219704.180031:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000845abbe5) 00000020:00000080:3.0:1785219704.180048:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1785219704.180268:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006651819a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785219704.180272:0:5822:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006651819a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785219704.180274:0:5822:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006651819a 4 00010000:00080000:3.0:1785219704.180311:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a8987b1c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1785219704.183050:0:5822:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1785219704.183213:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1785219704.183253:0:5822:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785219704.183264:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8b38d407a078c50f 00000100:00080000:3.0:1785219704.183274:0:5822:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785219704.183347:0:5822:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a8987b1c using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1785219704.183400:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000edd989e6 x1871938465040896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785219704.183417:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1785219704.183594:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd989e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465040896:0@lo:38: 00000100:00100000:1.0:1785219704.183662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219704.183726:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465040896 00000100:00100000:1.0:1785219704.183732:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465040896 00000100:00100000:1.0:1785219704.183764:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219704.183771:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc51a2e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1871938465040896:12345-0@lo:38: 00000100:00100000:1.0:1785219704.183821:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc51a2e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1871938465040896:12345-0@lo:38: Request processed in 49us (159us total) trans 0 rc -11/-11 00000100:00100000:1.0:1785219704.183833:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219704.184261:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785219704.184268:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000a8987b1c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785219704.184273:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1785219704.184276:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd989e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465040896:0@lo:38: 00000100:00100000:3.0:1785219704.184519:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000564efd38 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5822:1871938465041024:0@lo:502: 00000100:00100000:3.0:1785219704.184567:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219704.184590:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dab5680c going to sleep for 11 seconds 00000100:00100000:0.0:1785219704.184592:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041024 00000100:00100000:0.0:1785219704.184596:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041024 00000100:00100000:0.0:1785219704.184634:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785219704.184640:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004595bdb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5822:x1871938465041024:12345-0@lo:502: 00000100:00100000:0.0:1785219704.184852:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004595bdb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5822:x1871938465041024:12345-0@lo:502: Request processed in 212us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219704.184860:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785219704.184885:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000564efd38 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:5822:1871938465041024:0@lo:502: 00000040:00080000:1.0:1785219704.184907:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1785219704.185084:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1785219704.185116:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785219704.185134:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.185164:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785219704.185205:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785219704.185207:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785219704.185209:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219704.185210:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219704.185211:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219704.185212:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219704.185213:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785219704.185215:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785219704.185216:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219704.185217:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219704.185219:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219704.185220:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785219704.185223:0:5774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1785219704.185226:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785219704.185227:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785219704.185228:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219704.185229:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219704.185230:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219704.185232:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219704.185232:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785219704.185233:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785219704.185234:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219704.185235:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219704.185236:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219704.185236:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785219704.185250:0:5774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1785219704.185258:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb0b567c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465041152:0@lo:253: 00000100:00100000:3.0:1785219704.185297:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219704.185321:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000005207e051 going to sleep for 11 seconds 00000100:00100000:3.0:1785219704.185559:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041152 00000100:00100000:3.0:1785219704.185564:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041152 00000100:00100000:3.0:1785219704.185593:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785219704.185604:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bdfb637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5774:x1871938465041152:12345-0@lo:253: 20000000:01000000:3.0:1785219704.185632:0:5788:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1785219704.185644:0:5788:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1785219704.232923:0:5788:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1785219704.232949:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1785219704.233008:0:5809:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785219704.233014:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785219704.233035:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233053:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c4de expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233081:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233131:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c4de expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233145:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c4de expref: 12 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219704.233160:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d74cbc1a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1871938465041280:0@lo:104: 00000100:00100000:0.0:1785219704.233223:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219704.233296:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 0000000010f2be9d going to sleep for 11 seconds 00000100:00100000:3.0:1785219704.233454:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041280 00000100:00100000:3.0:1785219704.233461:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041280 00000100:00100000:3.0:1785219704.233510:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219704.233518:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af265760 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5809:x1871938465041280:12345-0@lo:104: 00010000:00010000:3.0:1785219704.233530:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219704.233578:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785219704.233583:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af265760 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5809:x1871938465041280:12345-0@lo:104: Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219704.233591:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1785219704.233837:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219704.233843:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233851:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a6e0252a already unused, calling callback (0000000043cbd78b) 10000000:00010000:0.0:1785219704.233854:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233861:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219704.233867:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219704.233873:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219704.233906:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233925:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219704.233951:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233958:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000a6e0252a/0x8b38d407a078c4de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c4e5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.233975:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219704.233977:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219704.233978:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219704.234004:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d74cbc1a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1871938465041280:0@lo:104: 00010000:00010000:0.0:1785219704.234021:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219704.234193:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219704.234203:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000032a8c285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465041408:0@lo:103: 00000100:00100000:1.0:1785219704.234236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219704.234391:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041408 00000100:00100000:2.0:1785219704.234398:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041408 00010000:00010000:2.0:1785219704.234415:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c4de expref: 13 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219704.234471:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785219704.234478:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb99bff8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:3306:x1871938465041408:12345-0@lo:103: 00010000:00010000:2.0:1785219704.234488:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219704.234493:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c4de expref: 13 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234501:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c4de expref: 13 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234513:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002f977fb2/0x8b38d407a078c4e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c4de expref: 13 pid: 5788 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234527:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234533:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1785219704.234547:0:5778:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001534796s 00010000:00010000:2.0:1785219704.234551:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234557:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234563:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234568:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234579:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd52c720 already unused, calling callback (000000002ca9618a) 00010000:00010000:2.0:1785219704.234582:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234588:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234599:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219704.234607:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219704.234634:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb99bff8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:3306:x1871938465041408:12345-0@lo:103: Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219704.234642:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219704.234821:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000032a8c285 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465041408:0@lo:103: 00010000:00010000:0.0:1785219704.235018:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.235026:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219704.235032:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dd52c720/0x8b38d407a078c516 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219704.243237:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bdfb637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5774:x1871938465041152:12345-0@lo:253: Request processed in 57627us (57932us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219704.243252:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785219704.243440:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb0b567c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:5774:1871938465041152:0@lo:253: 10000000:01000000:1.0:1785219704.243576:0:5774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785219704.243580:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785219704.243582:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785219704.243583:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219704.243584:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219704.243585:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219704.243587:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219704.243588:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785219704.243589:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785219704.243591:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785219704.243592:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785219704.243593:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219704.243594:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1785219704.243610:0:5774:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1785219704.256003:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219704.256809:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219704.257024:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219704.257223:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219704.257803:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219704.257969:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219704.259589:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219704.259791:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219704.259991:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219704.260401:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219704.260795:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219704.260998:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1785219704.310027:0:5774:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1785219704.364012:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1785219704.364212:0:5827:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1785219704.364216:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1785219704.364602:0:5828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1785219704.371049:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1785219704.374296:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1785219704.374868:0:5774:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1785219704.374879:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1785219704.375038:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785219704.377613:0:5774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1785219704.378716:0:5774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1785219704.378758:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1785219704.379068:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1785219704.379296:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1785219704.387188:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1785219704.389610:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1785219704.389919:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1785219704.390057:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1785219704.390764:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1785219704.390922:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1785219704.391082:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1785219704.391243:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1785219704.391451:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1785219704.391604:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1785219704.392931:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1785219704.393107:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1785219704.393256:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1785219704.393423:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1785219704.393593:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1785219704.393743:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1785219704.394068:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1785219704.394217:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1785219704.394390:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1785219704.394533:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1785219704.394696:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1785219704.394861:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1785219704.395015:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1785219704.397822:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1785219704.398036:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1785219704.399390:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1785219704.403264:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1785219704.403732:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1785219704.403892:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1785219704.404056:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000040:00080000:0.0:1785219704.406186:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1785219704.407390:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1785219704.407687:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1785219704.407855:0:5774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1785219704.498227:0:5828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1785219704.498311:0:5828:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1785219704.498316:0:5828:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1785219704.569502:0:5774:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1785219704.569539:0:5774:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcd6c1caf988 00100000:10000000:3.0:1785219704.569548:0:5774:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1785219704.577013:0:5774:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785219704.577031:0:5774:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785219704.577042:0:5774:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1785219704.577058:0:5774:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1785219705.196616:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219706.220503:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219707.257064:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219708.268525:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785219709.141935:0:6071:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785219709.293130:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785219709.357503:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1785219709.357522:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1785219709.357526:0:475:0:(import.c:65:import_set_state_nolock()) 00000000a8987b1c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785219709.357537:0:475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a8987b1c using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1785219709.357560:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002cfd247e x1871938465041664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785219709.357596:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002cfd247e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465041664:0@lo:38: 00000100:00100000:2.0:1785219709.357661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219709.357886:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d33d5c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465041536:0@lo:400: 00000100:00100000:1.0:1785219709.357920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219709.357994:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041536 00000100:00100000:2.0:1785219709.358001:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041536 00000100:00100000:2.0:1785219709.358048:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785219709.358072:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000775aef70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3308:x1871938465041536:12345-0@lo:400: 00000100:00100000:2.0:1785219709.358122:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000775aef70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3308:x1871938465041536:12345-0@lo:400: Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219709.358128:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785219709.358181:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d33d5c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465041536:0@lo:400: 00000100:00100000:3.0:1785219709.362204:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041664 00000100:00100000:3.0:1785219709.362218:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041664 00000100:00100000:3.0:1785219709.362254:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785219709.362260:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e7b698b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1871938465041664:12345-0@lo:38: 00010000:00080000:3.0:1785219709.362288:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1785219709.362321:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8b38d407a078c51d 00000004:00100000:3.0:1785219709.362393:0:5795:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1785219709.362545:0:5795:0:(import.c:65:import_set_state_nolock()) 000000008cda1f4d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785219709.362623:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e7b698b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871938465041664:12345-0@lo:38: Request processed in 361us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219709.362630:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785219709.363478:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002cfd247e x1871938465041664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785219719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785219709.363499:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1785219709.363507:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1785219709.363523:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785219709.363525:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000a8987b1c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1785219709.363531:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002cfd247e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465041664:0@lo:38: 00010000:00010000:1.0:1785219710.316305:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219711.339739:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219712.363968:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785219712.428423:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1785219712.428433:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf3503a5000 from 3 10000000:01000000:2.0:1785219712.428440:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785219712.428565:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000002f977fb2/0x8b38d407a078c524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219712.428582:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000002f977fb2/0x8b38d407a078c524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219712.428595:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000002f977fb2/0x8b38d407a078c524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219712.428744:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002cfd247e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465041792:0@lo:101: 00000100:00100000:2.0:1785219712.428838:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219712.428951:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set 000000002bb82f76 going to sleep for 11 seconds 00000100:00100000:0.0:1785219712.436407:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041792 00000100:00100000:0.0:1785219712.436429:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041792 00000100:00100000:0.0:1785219712.436900:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785219712.436912:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041f3b12f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5790:x1871938465041792:12345-0@lo:101: 00010000:00010000:0.0:1785219712.436938:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219712.436964:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd52c720/0x8b38d407a078c52b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c524 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219712.436999:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd52c720/0x8b38d407a078c52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c524 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219712.437011:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd52c720/0x8b38d407a078c52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c524 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219712.437052:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd52c720, rc 0) 00000100:00100000:0.0:1785219712.437178:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041f3b12f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465041792:12345-0@lo:101: Request processed in 269us (8340us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219712.437186:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785219712.443272:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002cfd247e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465041792:0@lo:101: 00010000:00010000:3.0:1785219712.443313:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000002f977fb2/0x8b38d407a078c524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219712.443327:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000002f977fb2/0x8b38d407a078c524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219712.443458:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c1f81c34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465041920:0@lo:256: 00000100:00100000:3.0:1785219712.443767:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219712.443870:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cf16f5f going to sleep for 11 seconds 00000100:00100000:0.0:1785219712.447680:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465041920 00000100:00100000:0.0:1785219712.447847:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465041920 00000100:00100000:0.0:1785219712.447969:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785219712.447982:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000754b4b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465041920:12345-0@lo:256: 20000000:01000000:0.0:1785219712.448020:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1785219712.448057:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1785219712.448060:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1785219712.448315:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000754b4b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465041920:12345-0@lo:256: Request processed in 335us (4548us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219712.448323:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785219712.450338:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c1f81c34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465041920:0@lo:256: 10000000:01000000:2.0:1785219712.450432:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785219712.450444:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000002f977fb2/0x8b38d407a078c524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219712.450457:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000002f977fb2/0x8b38d407a078c524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219713.387694:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785219714.119052:0:6272:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc8352100 20000000:00000080:0.0:1785219714.119077:0:6272:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf3810b1800 uarg=0000000000000000 20000000:01000000:0.0:1785219714.119125:0:6272:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1785219714.119136:0:6272:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1785219714.119142:0:6272:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1785219714.119790:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1785219714.119805:0:6272:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1785219714.123716:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785219714.124066:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1785219714.124134:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1785219714.124192:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1785219714.124214:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1785219714.124241:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.124271:0:6272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.124280:0:6272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.124340:0:6272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.124444:0:6272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 11 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219714.124463:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d74cbc1a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1871938465042048:0@lo:104: 00000100:00100000:0.0:1785219714.124551:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219714.124663:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ee589df0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219714.124753:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042048 00000100:00100000:2.0:1785219714.124763:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042048 00000100:00100000:2.0:1785219714.125198:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219714.125210:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3675345 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+3:6272:x1871938465042048:12345-0@lo:104: 00010000:00010000:2.0:1785219714.125227:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219714.125306:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785219714.125312:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3675345 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+3:6272:x1871938465042048:12345-0@lo:104: Request processed in 106us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219714.125320:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1785219714.125391:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219714.125398:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125407:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051370f9d already unused, calling callback (0000000043cbd78b) 10000000:00010000:1.0:1785219714.125411:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125419:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219714.125426:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219714.125432:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785219714.125473:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125480:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219714.125501:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125508:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 0000000051370f9d/0x8b38d407a078c4ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c4f3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125541:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219714.125543:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219714.125544:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219714.125568:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465042176:0@lo:103: 00000100:00100000:1.0:1785219714.125604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219714.125657:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042176 00000100:00100000:1.0:1785219714.125663:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042176 00010000:00010000:1.0:1785219714.125683:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 12 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219714.125708:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219714.125714:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4058c2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:3309:x1871938465042176:12345-0@lo:103: 00010000:00010000:1.0:1785219714.125727:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219714.125731:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 12 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125741:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 12 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125761:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125769:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125784:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125790:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125802:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125809:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125814:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0af009f already unused, calling callback (000000002ca9618a) 00010000:00010000:1.0:1785219714.125817:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125825:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125833:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219714.125844:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219714.125874:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4058c2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:3309:x1871938465042176:12345-0@lo:103: Request processed in 160us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219714.125881:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219714.125920:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465042176:0@lo:103: 00010000:00010000:0.0:1785219714.126027:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000965b4ce1/0x8b38d407a078c4f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c4ec expref: 11 pid: 5785 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219714.126048:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d74cbc1a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1871938465042048:0@lo:104: 00010000:00010000:0.0:1785219714.126064:0:6272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.126073:0:6272:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.126078:0:6272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.126083:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0af009f/0x8b38d407a078c532 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219714.416687:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219714.475913:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f469fa7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465042432:0@lo:400: 00000100:00100000:0.0:1785219714.476025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219714.476130:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219714.476137:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000034604b8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465042304:0@lo:400: 00000100:00100000:0.0:1785219714.476173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219714.476211:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042304 00000100:00100000:0.0:1785219714.476222:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042304 00000100:00100000:0.0:1785219714.476276:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785219714.476285:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000759f8936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3307:x1871938465042304:12345-0@lo:400: 00000100:00100000:0.0:1785219714.476342:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000759f8936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3307:x1871938465042304:12345-0@lo:400: Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219714.476349:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785219714.476429:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034604b8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465042304:0@lo:400: 00000100:00100000:3.0:1785219714.477019:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042432 00000100:00100000:3.0:1785219714.477038:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042432 00000100:00100000:3.0:1785219714.477087:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219714.477095:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d74cbc1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465042432:12345-0@lo:400: 00000100:00100000:3.0:1785219714.477163:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d74cbc1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465042432:12345-0@lo:400: Request processed in 69us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219714.477170:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1785219714.477254:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f469fa7d x1871938465042432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219714.477269:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f469fa7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465042432:0@lo:400: 00010000:00010000:1.0:1785219715.435652:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219716.459524:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219717.484503:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219718.512087:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1785219719.086433:0:6584:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785219719.086439:0:6584:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1785219719.086581:0:6584:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000020a9d4b0 00000020:01000004:3.0:1785219719.086598:0:6584:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1785219719.086609:0:6584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785219719.086622:0:6584:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000facdcf19) 00000020:00000080:3.0:1785219719.086643:0:6584:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1785219719.103877:0:6584:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1785219719.105573:0:6584:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1785219719.132819:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1785219719.148923:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785219719.148957:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1785219719.149025:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785219719.149054:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1785219719.149843:0:6584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1785219719.149854:0:6584:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1785219719.149864:0:6584:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8b38d407a078c540 00000020:01000004:2.0:1785219719.149877:0:6584:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1785219719.149895:0:6584:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1785219719.149898:0:6584:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1785219719.149902:0:6584:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1785219719.149906:0:6584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1785219719.149915:0:6584:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000090066c16) 00000020:00000080:2.0:1785219719.149925:0:6584:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1785219719.151107:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785219719.151239:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1785219719.151244:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1785219719.159567:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1785219719.160945:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1785219719.161291:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1785219719.161298:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1785219719.162946:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785219719.163132:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1785219719.163138:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1785219719.163871:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1785219719.163879:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1785219719.184890:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785219719.185128:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1785219719.185134:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1785219719.190903:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1785219719.190923:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1785219719.191745:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1785219719.191755:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1785219719.195314:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785219719.195854:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1785219719.195860:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1785219719.196323:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1785219719.196511:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1785219719.269918:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785219719.272044:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1785219719.272056:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1785219719.275250:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1785219719.275274:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1785219719.279543:0:6584:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1785219719.279569:0:6584:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1785219719.279575:0:6584:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1785219719.325830:0:6584:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1785219719.325887:0:6584:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1785219719.325891:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1785219719.325893:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785219719.325895:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219719.325896:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219719.325897:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219719.325898:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219719.325899:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785219719.325901:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219719.325902:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219719.325904:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219719.325905:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219719.325909:0:6584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1785219719.325911:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785219719.325912:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785219719.325913:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219719.325914:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219719.325915:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219719.325916:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219719.325917:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785219719.325918:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219719.325919:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219719.325920:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219719.325921:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219719.325947:0:6584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1785219719.325965:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000876510ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465042560:0@lo:253: 00000100:00100000:3.0:1785219719.326051:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.326185:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000006b792eff going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.326521:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042560 00000100:00100000:0.0:1785219719.326530:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042560 00000100:00100000:1.0:1785219719.326857:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785219719.326868:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045ee0e82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465042560:12345-0@lo:253: 20000000:01000000:1.0:1785219719.326910:0:5785:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1785219719.326914:0:5785:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1785219719.326919:0:5785:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1785219719.326921:0:5785:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1785219719.332244:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219719.332941:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1785219719.332957:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1785219719.333015:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1785219719.333023:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1785219719.333055:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1785219719.333108:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1785219719.340159:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1785219719.340203:0:5785:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:1.0:1785219719.340206:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:1.0:1785219719.340247:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1785219719.340256:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1785219719.340738:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1785219719.340749:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:1.0:1785219719.340785:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1785219719.340796:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1785219719.340831:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1785219719.340888:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1785219719.342078:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1785219719.342103:0:5785:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:1.0:1785219719.342105:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:1.0:1785219719.342143:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1785219719.342152:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1785219719.342456:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1785219719.342489:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:1.0:1785219719.342546:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1785219719.342557:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1785219719.342607:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1785219719.342646:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1785219719.342663:0:5785:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1785219719.342666:0:5785:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1785219719.342673:0:5785:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1785219719.342674:0:5785:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1785219719.342676:0:5785:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1785219719.343255:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1785219719.343509:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1785219719.343555:0:5785:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1785219719.343558:0:5785:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1785219719.346961:0:6599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1785219719.347063:0:6599:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1785219719.347117:0:6599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1785219719.347664:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1785219719.349745:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1785219719.349845:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1785219719.349866:0:5785:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1785219719.349869:0:5785:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1785219719.351068:0:6600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1785219719.351139:0:6600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1785219719.351187:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1785219719.351930:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1785219719.351976:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1785219719.352021:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1785219719.352033:0:5785:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1785219719.352035:0:5785:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1785219719.352648:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1785219719.352983:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1785219719.353045:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1785219719.353110:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1785219719.353133:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1785219719.353150:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.353167:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c46e expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.353173:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c48a expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.353179:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.353199:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.353238:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.353250:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 11 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219719.353266:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d33d5c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5785:1871938465042688:0@lo:104: 00000100:00100000:2.0:1785219719.353561:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785219719.353658:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c48a expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.353666:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c48a expref: 11 pid: 5785 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219719.353673:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003d936b30 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5785:1871938465042816:0@lo:104: 00000100:00100000:2.0:1785219719.353706:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785219719.358965:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c46e expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.358987:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c46e expref: 11 pid: 5787 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219719.359011:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dd759243 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5785:1871938465042944:0@lo:104: 00000100:00100000:2.0:1785219719.359072:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.364833:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042688 00000100:00100000:3.0:1785219719.364849:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042688 00000100:00100000:3.0:1785219719.364906:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042816 00000100:00100000:3.0:1785219719.364910:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042816 00000100:00100000:3.0:1785219719.364928:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219719.364936:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023acbf4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:5785:x1871938465042688:12345-0@lo:104: 00010000:00010000:3.0:1785219719.364955:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365069:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785219719.365075:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023acbf4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:5785:x1871938465042688:12345-0@lo:104: Request processed in 139us (11515us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219719.365082:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219719.365099:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219719.365105:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2283f4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5785:x1871938465042816:12345-0@lo:104: 00010000:00010000:3.0:1785219719.365112:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365150:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785219719.365154:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2283f4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5785:x1871938465042816:12345-0@lo:104: Request processed in 51us (11449us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219719.365160:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1785219719.365196:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785219719.365214:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365220:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005bacd8ac already unused, calling callback (0000000043cbd78b) 10000000:00010000:3.0:1785219719.365224:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365231:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785219719.365236:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219719.365242:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785219719.365276:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365284:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785219719.365300:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365306:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000005bacd8ac/0x8b38d407a078c4fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c501 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365315:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219719.365317:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365335:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d193f3d already unused, calling callback (0000000043cbd78b) 10000000:00010000:3.0:1785219719.365338:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365354:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785219719.365359:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219719.365392:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785219719.365405:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365411:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785219719.365416:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365422:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c48a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c491 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.365431:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219719.365433:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219719.365434:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219719.365458:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e63fb122 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465043072:0@lo:103: 00000100:00100000:3.0:1785219719.365496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.365534:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785219719.365540:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000604fb826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465043200:0@lo:103: 00000100:00100000:3.0:1785219719.365560:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.365592:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043072 00000100:00100000:3.0:1785219719.365596:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043072 00010000:00010000:3.0:1785219719.365613:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 12 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219719.365642:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043200 00000100:00100000:3.0:1785219719.365645:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043200 00010000:00010000:3.0:1785219719.365673:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c48a expref: 13 pid: 5785 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.365892:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219719.366102:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000010a4d841 going to sleep for 11 seconds 00000100:00100000:2.0:1785219719.366123:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d33d5c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5785:1871938465042688:0@lo:104: 00000100:00100000:2.0:1785219719.366158:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003d936b30 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5785:1871938465042816:0@lo:104: 00000100:00100000:1.0:1785219719.366283:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465042944 00000100:00100000:1.0:1785219719.366289:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465042944 00000100:00100000:1.0:1785219719.366327:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785219719.366332:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1785219719.366334:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce818024 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5785:x1871938465042944:12345-0@lo:104: 00010000:00010000:1.0:1785219719.366343:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219719.366349:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1785219719.366413:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785219719.366415:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219719.366417:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce818024 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5785:x1871938465042944:12345-0@lo:104: Request processed in 85us (7346us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.366421:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000866dcc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:3308:x1871938465043072:12345-0@lo:103: 00000100:00100000:1.0:1785219719.366424:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1785219719.366432:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219719.366437:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.366471:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.366486:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000006d818fb/0x8b38d407a078c501 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c4fa expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.366499:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219719.366543:0:5780:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785219719.366549:0:5780:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1785219719.366558:0:5779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785219719.366566:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219719.366571:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045bf2920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:3308:x1871938465043200:12345-0@lo:103: 00010000:00010000:3.0:1785219719.366580:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219719.366584:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c48a expref: 12 pid: 5785 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366592:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c48a expref: 12 pid: 5785 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366600:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2ebdc28/0x8b38d407a078c491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c48a expref: 12 pid: 5785 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366611:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219719.366648:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045bf2920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3308:x1871938465043200:12345-0@lo:103: Request processed in 77us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219719.366654:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1785219719.366670:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219719.366674:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366692:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8984818 already unused, calling callback (0000000043cbd78b) 10000000:00010000:3.0:1785219719.366701:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366708:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785219719.366713:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219719.366718:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785219719.366739:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366744:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785219719.366758:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366763:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c46e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c475 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366776:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219719.366778:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219719.366779:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219719.366790:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c747175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465043328:0@lo:103: 00000100:00100000:3.0:1785219719.366818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219719.366837:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dd759243 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5785:1871938465042944:0@lo:104: 00000100:00100000:3.0:1785219719.366850:0:5779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785219719.366855:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043328 00000100:00100000:3.0:1785219719.366858:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043328 00010000:00010000:2.0:1785219719.366860:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366868:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c46e expref: 11 pid: 5787 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219719.366889:0:5779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785219719.366895:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785219719.366899:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a314105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3306:x1871938465043328:12345-0@lo:103: 00010000:00010000:3.0:1785219719.366906:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219719.366910:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c46e expref: 11 pid: 5787 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366917:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c46e expref: 11 pid: 5787 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366925:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e24becfa/0x8b38d407a078c475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c46e expref: 11 pid: 5787 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366935:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366942:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366952:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366958:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366963:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366969:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366983:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026e8ae51 already unused, calling callback (000000002ca9618a) 00010000:00010000:3.0:1785219719.366986:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.366993:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.367022:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.367031:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219719.367052:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a314105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+10:3306:x1871938465043328:12345-0@lo:103: Request processed in 153us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.367052:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000866dcc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+10:3308:x1871938465043072:12345-0@lo:103: Request processed in 631us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219719.367058:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1785219719.367086:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.367092:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219719.367095:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000604fb826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465043200:0@lo:103: 00010000:00010000:2.0:1785219719.367098:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c54e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219719.367102:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e63fb122 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465043072:0@lo:103: 20000000:01000000:2.0:1785219719.367113:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1785219719.370239:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219719.370242:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c747175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465043328:0@lo:103: 00000100:00100000:0.0:1785219719.461626:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045ee0e82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+8:6584:x1871938465042560:12345-0@lo:253: Request processed in 134752us (135568us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.461642:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785219719.461770:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000876510ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465042560:0@lo:253: 10000000:01000000:3.0:1785219719.461787:0:6584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1785219719.461790:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785219719.461791:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785219719.461793:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219719.461794:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1785219719.461795:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219719.461797:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219719.461798:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785219719.461800:0:6584:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1785219719.461802:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219719.461803:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1785219719.461826:0:6584:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000020a9d4b0 from lustre-OST0000 10000000:01000000:3.0:1785219719.461852:0:6584:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1785219719.461855:0:6584:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1785219719.461876:0:6584:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf3486699c0 local copy 10000000:01000000:3.0:1785219719.461881:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1785219719.461917:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.461927:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.461936:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219719.461964:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000876510ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043456:0@lo:101: 00000100:00100000:3.0:1785219719.462010:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.462063:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000008df0b023 going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.462180:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043456 00000100:00100000:0.0:1785219719.462187:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043456 00000100:00100000:0.0:1785219719.462225:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785219719.462232:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047d3ba52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+8:6584:x1871938465043456:12345-0@lo:101: 00010000:00010000:0.0:1785219719.462244:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219719.462257:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0af009f/0x8b38d407a078c55c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c555 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.462278:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0af009f/0x8b38d407a078c55c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c555 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.462287:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0af009f/0x8b38d407a078c55c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c555 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.462295:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0af009f, rc 0) 00000100:00100000:0.0:1785219719.462348:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047d3ba52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+9:6584:x1871938465043456:12345-0@lo:101: Request processed in 116us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.462353:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785219719.462769:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000876510ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043456:0@lo:101: 00010000:00010000:3.0:1785219719.462783:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.462790:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219719.462883:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000876510ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043584:0@lo:501: 00000100:00100000:3.0:1785219719.462915:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.462945:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000008df0b023 going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.463073:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043584 00000100:00100000:0.0:1785219719.463079:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043584 00000100:00100000:0.0:1785219719.463114:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785219719.463121:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e64c5f52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+9:6584:x1871938465043584:12345-0@lo:501: 00000100:00100000:0.0:1785219719.463334:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e64c5f52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+9:6584:x1871938465043584:12345-0@lo:501: Request processed in 213us (419us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785219719.463341:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785219719.463504:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000876510ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043584:0@lo:501: 10000000:01000000:1.0:1785219719.463520:0:6584:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1785219719.463547:0:6584:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1785219719.463551:0:6584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.463559:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.463565:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.463587:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1785219719.463604:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf349c7c000 10000000:01000000:1.0:1785219719.463609:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785219719.463613:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cf3486699c0 10000000:01000000:1.0:1785219719.463615:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1785219719.463618:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9cf3486699c0 from 1 10000000:01000000:1.0:1785219719.463621:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1785219719.463642:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 0000000003cf4ab1/0x8b38d407a078c563 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.463656:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 0000000003cf4ab1/0x8b38d407a078c563 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.463664:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 0000000003cf4ab1/0x8b38d407a078c563 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219719.463678:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043712:0@lo:101: 00000100:00100000:1.0:1785219719.463706:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.463738:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 0000000046e8c93a going to sleep for 11 seconds 00000100:00100000:2.0:1785219719.463800:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043712 00000100:00100000:2.0:1785219719.463805:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043712 00000100:00100000:2.0:1785219719.463838:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785219719.463844:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bacf2632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+9:6584:x1871938465043712:12345-0@lo:101: 00010000:00010000:2.0:1785219719.463852:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219719.463862:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c56a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c563 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.463877:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c563 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.463884:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026e8ae51/0x8b38d407a078c56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c563 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.463890:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026e8ae51, rc 0) 00000100:00100000:2.0:1785219719.463923:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bacf2632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465043712:12345-0@lo:101: Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219719.463929:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785219719.464067:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043712:0@lo:101: 00010000:00010000:1.0:1785219719.464078:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 0000000003cf4ab1/0x8b38d407a078c563 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c56a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464085:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 0000000003cf4ab1/0x8b38d407a078c563 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c56a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219719.464100:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1785219719.464115:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 0000000003cf4ab1/0x8b38d407a078c563 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c56a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464121:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 0000000003cf4ab1/0x8b38d407a078c563 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c56a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219719.464128:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1785219719.464131:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785219719.464135:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1785219719.464137:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1785219719.464149:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464159:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464166:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219719.464176:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043840:0@lo:101: 00000100:00100000:1.0:1785219719.464200:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.464211:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 0000000046e8c93a going to sleep for 11 seconds 00000100:00100000:1.0:1785219719.464225:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043840 00000100:00100000:1.0:1785219719.464229:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043840 00000100:00100000:1.0:1785219719.464247:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785219719.464252:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c189a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465043840:12345-0@lo:101: 00010000:00010000:1.0:1785219719.464259:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219719.464266:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f3ead8e/0x8b38d407a078c578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c571 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464278:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f3ead8e/0x8b38d407a078c578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c571 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464286:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f3ead8e/0x8b38d407a078c578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c571 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464291:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f3ead8e, rc 0) 00000100:00100000:1.0:1785219719.464331:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c189a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465043840:12345-0@lo:101: Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.464338:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785219719.464389:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043840:0@lo:101: 00010000:00010000:1.0:1785219719.464406:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.464412:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219719.464470:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043968:0@lo:501: 00000100:00100000:1.0:1785219719.464494:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.464507:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 0000000046e8c93a going to sleep for 11 seconds 00000100:00100000:1.0:1785219719.464525:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465043968 00000100:00100000:1.0:1785219719.464529:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465043968 00000100:00100000:1.0:1785219719.464544:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785219719.464549:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f3b4fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465043968:12345-0@lo:501: 00000100:00100000:1.0:1785219719.464744:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f3b4fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465043968:12345-0@lo:501: Request processed in 194us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.464750:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785219719.464773:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465043968:0@lo:501: 00000100:00100000:1.0:1785219719.464798:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044096:0@lo:503: 00000100:00100000:1.0:1785219719.464833:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.464841:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 0000000046e8c93a going to sleep for 11 seconds 00000100:00100000:1.0:1785219719.464858:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044096 00000100:00100000:1.0:1785219719.464862:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044096 00000100:00100000:1.0:1785219719.464876:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785219719.464880:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d049626 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044096:12345-0@lo:503: 00010000:00010000:0.0:1785219719.466664:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219719.466676:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.466699:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8984818 already unused, calling callback (0000000043cbd78b) 10000000:00010000:0.0:1785219719.466702:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.466711:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219719.466718:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219719.466724:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219719.466762:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.466768:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219719.466809:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.466830:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: 00000000f8984818/0x8b38d407a078c555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8b38d407a078c55c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.466848:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219719.466850:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219719.466852:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219719.466918:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000593f4302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465044224:0@lo:103: 00000100:00100000:3.0:1785219719.466991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219719.467159:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044224 00000100:00100000:0.0:1785219719.467166:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044224 00000100:00100000:0.0:1785219719.467223:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219719.467231:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c747175 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:3307:x1871938465044224:12345-0@lo:103: 00010000:00010000:0.0:1785219719.467243:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219719.467255:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0af009f/0x8b38d407a078c55c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c555 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.467267:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219719.467301:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c747175 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3307:x1871938465044224:12345-0@lo:103: Request processed in 71us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.467307:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219719.467749:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000593f4302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465044224:0@lo:103: 00000100:00100000:1.0:1785219719.467915:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d049626 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465044096:12345-0@lo:503: Request processed in 3033us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.467923:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1785219719.472241:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001048048c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044096:0@lo:503: 00000040:00080000:2.0:1785219719.472802:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785219719.472904:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dd759243 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044352:0@lo:502: 00000100:00100000:2.0:1785219719.473125:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219719.473276:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000004aa2f373 going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.477991:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044352 00000100:00100000:0.0:1785219719.478021:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044352 00000100:00100000:1.0:1785219719.478205:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785219719.478215:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3d2843d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465044352:12345-0@lo:502: 00000100:00100000:1.0:1785219719.478517:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3d2843d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465044352:12345-0@lo:502: Request processed in 303us (5392us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.478525:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785219719.478944:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dd759243 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044352:0@lo:502: 00000040:00080000:2.0:1785219719.479298:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1785219719.479404:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1785219719.479446:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1785219719.479495:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1785219719.479535:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1785219719.480227:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1785219719.480272:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dd759243 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044480:0@lo:502: 00000100:00100000:2.0:1785219719.480497:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.483241:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044480 00000100:00100000:1.0:1785219719.483255:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044480 00000100:00100000:1.0:1785219719.483316:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000004aa2f373 going to sleep for 11 seconds 00000100:00100000:1.0:1785219719.483409:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785219719.483419:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059f37f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465044480:12345-0@lo:502: 00000100:00100000:1.0:1785219719.484131:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059f37f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465044480:12345-0@lo:502: Request processed in 712us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.484141:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1785219719.484326:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dd759243 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044480:0@lo:502: 00000040:00080000:2.0:1785219719.484544:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1785219719.484632:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1785219719.485877:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1785219719.485886:0:6605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1785219719.485891:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219719.485893:0:6605:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1785219719.485897:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785219719.485910:0:6605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000316a765b) 00000020:00000080:2.0:1785219719.485930:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1785219719.485935:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785219719.486105:0:6605:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000020a9d4b0 from lustre-OST0000, refs=2 00080000:01000000:2.0:1785219719.486113:0:6605:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785219719.486120:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8b38d407a078c586 00010000:00010000:3.0:1785219719.499933:0:6605:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1785219719.500846:0:6605:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1785219719.507310:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1785219719.509231:0:6605:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1785219719.534892:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00010000:00010000:2.0:1785219719.535469:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1785219719.536141:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1785219719.543473:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1785219719.543487:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219719.543493:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219719.543496:0:6605:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1785219719.543499:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785219719.543503:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219719.543504:0:6605:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1785219719.543507:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1785219719.543509:0:6605:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1785219719.543576:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219719.543580:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219719.543582:0:6605:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1785219719.543585:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1785219719.543923:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1785219719.543951:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1785219719.543985:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c571 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.544007:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: 000000005d193f3d/0x8b38d407a078c571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219719.544016:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf349c7c000 from 1 10000000:01000000:1.0:1785219719.544019:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785219719.544055:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: 00000000dcbf7726/0x8b38d407a078c58d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.544063:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: 00000000dcbf7726/0x8b38d407a078c58d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.544084:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: 00000000dcbf7726/0x8b38d407a078c58d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219719.544109:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044608:0@lo:101: 00000100:00100000:1.0:1785219719.544174:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.544222:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000003110007d going to sleep for 11 seconds 00000100:00100000:2.0:1785219719.544758:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044608 00000100:00100000:2.0:1785219719.544766:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044608 00000100:00100000:2.0:1785219719.544817:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785219719.544824:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008aba1a59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+10:6584:x1871938465044608:12345-0@lo:101: 00010000:00010000:2.0:1785219719.544838:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219719.544851:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000844fb6ff/0x8b38d407a078c594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c58d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.544873:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000844fb6ff/0x8b38d407a078c594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c58d expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.544883:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000844fb6ff/0x8b38d407a078c594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c58d expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.544904:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000844fb6ff, rc 0) 00000100:00100000:2.0:1785219719.544946:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008aba1a59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044608:12345-0@lo:101: Request processed in 123us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219719.545031:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785219719.545179:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044608:0@lo:101: 00010000:00010000:1.0:1785219719.545194:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: 00000000dcbf7726/0x8b38d407a078c58d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.545201:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: 00000000dcbf7726/0x8b38d407a078c58d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219719.545295:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044736:0@lo:501: 00000100:00100000:1.0:1785219719.545334:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.545386:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000003110007d going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.545498:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044736 00000100:00100000:0.0:1785219719.545503:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044736 00000100:00100000:0.0:1785219719.545529:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785219719.545534:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff62e733 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044736:12345-0@lo:501: 00000100:00100000:0.0:1785219719.545928:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff62e733 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044736:12345-0@lo:501: Request processed in 393us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.545935:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785219719.547014:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044736:0@lo:501: 00000100:00100000:1.0:1785219719.547062:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044864:0@lo:503: 00000100:00100000:1.0:1785219719.547114:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.547151:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000003110007d going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.547273:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044864 00000100:00100000:0.0:1785219719.547280:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044864 00000100:00100000:0.0:1785219719.547329:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785219719.547336:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097c609d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044864:12345-0@lo:503: 00000100:00100000:0.0:1785219719.547551:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097c609d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044864:12345-0@lo:503: Request processed in 215us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.547568:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785219719.556293:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044864:0@lo:503: 00000040:00080000:1.0:1785219719.556701:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785219719.556781:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044992:0@lo:502: 00000100:00100000:1.0:1785219719.556855:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.556905:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000003110007d going to sleep for 11 seconds 00000100:00100000:3.0:1785219719.557668:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465044992 00000100:00100000:3.0:1785219719.557677:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465044992 00000100:00100000:3.0:1785219719.557747:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785219719.557756:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb76af94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044992:12345-0@lo:502: 00000100:00100000:2.0:1785219719.560874:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb76af94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465044992:12345-0@lo:502: Request processed in 3112us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219719.560889:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785219719.561183:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465044992:0@lo:502: 00000040:00080000:1.0:1785219719.561508:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1785219719.562054:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1785219719.562097:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045120:0@lo:502: 00000100:00100000:1.0:1785219719.562153:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.562193:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set 000000003110007d going to sleep for 11 seconds 00000100:00100000:3.0:1785219719.563082:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465045120 00000100:00100000:3.0:1785219719.563093:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465045120 00000100:00100000:3.0:1785219719.563149:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785219719.563158:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a62678ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465045120:12345-0@lo:502: 00000100:00100000:3.0:1785219719.563401:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a62678ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465045120:12345-0@lo:502: Request processed in 244us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219719.563409:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1785219719.563627:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000166a46c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045120:0@lo:502: 00000040:00080000:2.0:1785219719.563762:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1785219719.563774:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1785219719.565432:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785219719.565446:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219719.565448:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1785219719.565456:0:6609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf349c7c000 00000020:00000080:2.0:1785219719.565458:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1785219719.565496:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219719.565500:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219719.565501:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1785219719.565504:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1785219719.565755:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1785219719.565779:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219719.565801:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.565813:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219719.565854:0:6584:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785219719.565857:0:6584:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf349c7c000 10000000:01000000:3.0:1785219719.565861:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf349c7c000 10000000:01000000:3.0:1785219719.565865:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785219719.565870:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf349c7c000 from 1 10000000:01000000:3.0:1785219719.565873:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785219719.565919:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.566256:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219719.566268:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219719.566291:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e467480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045248:0@lo:101: 00000100:00100000:3.0:1785219719.566473:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.568054:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.572974:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465045248 00000100:00100000:0.0:1785219719.572991:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465045248 00000100:00100000:1.0:1785219719.573261:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785219719.573272:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465045248:12345-0@lo:101: 00010000:00010000:1.0:1785219719.573289:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219719.573306:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c59b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.573344:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c59b expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.573355:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c59b expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.573506:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476c00, rc 0) 00000100:00100000:1.0:1785219719.573602:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045248:12345-0@lo:101: Request processed in 332us (7129us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.573609:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785219719.573772:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e467480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045248:0@lo:101: 00010000:00010000:2.0:1785219719.573792:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.573802:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219719.573921:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045376:0@lo:501: 00000100:00100000:2.0:1785219719.573967:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219719.575290:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a06fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219719.575421:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465045376 00000100:00100000:3.0:1785219719.575429:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465045376 00000100:00100000:1.0:1785219719.575861:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785219719.575872:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045376:12345-0@lo:501: 00000100:00100000:1.0:1785219719.576165:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045376:12345-0@lo:501: Request processed in 294us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.576172:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785219719.576268:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045376:0@lo:501: 00000100:00100000:3.0:1785219719.576315:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045504:0@lo:503: 00000100:00100000:3.0:1785219719.576390:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.582669:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e9976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.586087:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465045504 00000100:00100000:0.0:1785219719.586103:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465045504 00000100:00100000:0.0:1785219719.586170:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785219719.586180:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045504:12345-0@lo:503: 00000100:00100000:0.0:1785219719.586461:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045504:12345-0@lo:503: Request processed in 282us (10070us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.586470:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785219719.586752:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045504:0@lo:503: 00000040:00080000:3.0:1785219719.587073:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785219719.587144:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045632:0@lo:502: 00000100:00100000:3.0:1785219719.587191:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219719.587228:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e9976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.588635:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465045632 00000100:00100000:0.0:1785219719.588646:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465045632 00000100:00100000:0.0:1785219719.588698:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785219719.588707:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045632:12345-0@lo:502: 00000100:00100000:3.0:1785219719.589310:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045632:0@lo:502: 00000040:00080000:2.0:1785219719.589929:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1785219719.590084:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1785219719.590120:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1785219719.590168:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1785219719.590207:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1785219719.590272:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000100:00100000:0.0:1785219719.590539:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045632:12345-0@lo:502: Request processed in 1830us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.590549:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:2.0:1785219719.591144:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1785219719.591201:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1785219719.591259:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1785219719.591298:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1785219719.591942:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1785219719.592103:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1785219719.592139:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1785219719.592167:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1785219719.592210:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1785219719.592241:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1785219719.592267:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1785219719.592311:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1785219719.592675:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1785219719.592822:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1785219719.592879:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1785219719.592915:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1785219719.593055:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1785219719.593110:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1785219719.593148:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1785219719.593184:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1785219719.593234:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1785219719.593272:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1785219719.593524:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045760:0@lo:502: 00000100:00100000:2.0:1785219719.593755:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219719.593930:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a06fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219719.594061:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465045760 00000100:00100000:0.0:1785219719.594070:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465045760 00000100:00100000:0.0:1785219719.594157:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1785219719.594168:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045760:12345-0@lo:502: 00000100:00100000:0.0:1785219719.594767:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465045760:12345-0@lo:502: Request processed in 600us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.594783:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1785219719.594862:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465045760:0@lo:502: 00000040:00080000:2.0:1785219719.594963:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1785219719.594977:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1785219719.595344:0:6610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1785219719.595387:0:6610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cf245228000) 00000020:00000080:2.0:1785219719.595408:0:6610:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1785219719.595567:0:6610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf349c7c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1785219719.595571:0:6610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf349c7c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1785219719.595574:0:6610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf349c7c000 3 00010000:00080000:2.0:1785219719.595603:0:6610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf37e451000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1785219719.597273:0:6610:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1785219719.597427:0:6610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1785219719.597462:0:6610:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1785219719.597474:0:6610:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8b38d407a078c5b0 00000100:00080000:2.0:1785219719.597484:0:6610:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785219719.597489:0:6610:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cf37e451000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1785219719.597521:0:6610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf36dc03480 x1871938465045888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785219719.597561:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465045888:0@lo:38: 00000100:00100000:2.0:1785219719.597628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1785219719.597695:0:6610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1785219719.599989:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465046016:0@lo:400: 00000100:00100000:1.0:1785219719.600067:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219719.600127:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465045888 00000100:00100000:1.0:1785219719.600135:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465045888 00000100:00100000:1.0:1785219719.600166:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046016 00000100:00100000:1.0:1785219719.600169:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046016 00000100:00100000:1.0:1785219719.600194:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219719.600202:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465046016:12345-0@lo:400: 00000100:00100000:1.0:1785219719.600255:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465046016:12345-0@lo:400: Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.600263:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219719.600281:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219719.600285:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1871938465045888:12345-0@lo:38: 00010000:00080000:1.0:1785219719.600308:0:5794:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1785219719.600355:0:5794:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8b38d407a078c5b7 00000004:00100000:1.0:1785219719.600392:0:5794:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1785219719.600422:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9cf36f4ae000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219719.600463:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871938465045888:12345-0@lo:38: Request processed in 176us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.600470:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1785219719.600508:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf0bb80 x1871938465046016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219719.600524:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465046016:0@lo:400: 00010000:00080000:1.0:1785219719.600563:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36dc03480 x1871938465045888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785219729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219719.600572:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785219719.600585:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1785219719.600594:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1785219719.600599:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1785219719.600601:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf37e451000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1785219719.600608:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465045888:0@lo:38: 00000040:00080000:2.0:1785219719.610399:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1785219719.610451:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1785219719.610474:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785219719.610496:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219719.610521:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1785219719.610565:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1785219719.610567:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785219719.610568:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219719.610569:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785219719.610570:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219719.610571:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219719.610573:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219719.610574:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785219719.610576:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785219719.610577:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219719.610578:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785219719.610582:0:6584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1785219719.610584:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785219719.610585:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785219719.610586:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219719.610587:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785219719.610588:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219719.610589:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219719.610591:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219719.610592:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785219719.610593:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785219719.610594:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219719.610595:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785219719.610618:0:6584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1785219719.610636:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465046144:0@lo:253: 00000100:00100000:2.0:1785219719.610702:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219719.610745:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342cb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219719.610768:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046144 00000100:00100000:2.0:1785219719.610775:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046144 00000100:00100000:2.0:1785219719.610814:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785219719.610821:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6584:x1871938465046144:12345-0@lo:253: 20000000:01000000:2.0:1785219719.610856:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1785219719.610868:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1785219719.736061:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1785219719.736081:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1785219719.736391:0:5809:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785219719.736396:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785219719.736416:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.736435:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf340031200/0x8b38d407a078c52b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c524 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.736443:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.736479:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf340031200/0x8b38d407a078c52b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c524 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.736493:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf340031200/0x8b38d407a078c52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c524 expref: 12 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219719.736508:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1871938465046272:0@lo:104: 00000100:00100000:0.0:1785219719.736726:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219719.736785:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348bc79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219719.737015:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046272 00000100:00100000:1.0:1785219719.737024:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046272 00000100:00100000:1.0:1785219719.737078:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785219719.737087:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5809:x1871938465046272:12345-0@lo:104: 00010000:00010000:1.0:1785219719.737099:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219719.737151:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785219719.737157:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5809:x1871938465046272:12345-0@lo:104: Request processed in 72us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219719.737164:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1785219719.737290:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219719.737297:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737305:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80a00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219719.737309:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737318:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219719.737347:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219719.737354:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219719.737404:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737411:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219719.737428:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737435:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f80a00/0x8b38d407a078c524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c52b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737453:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219719.737455:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219719.737456:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219719.737466:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465046400:0@lo:103: 00000100:00100000:0.0:1785219719.737497:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219719.737529:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046400 00000100:00100000:0.0:1785219719.737533:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046400 00010000:00010000:0.0:1785219719.737548:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf340031200/0x8b38d407a078c52b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c524 expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219719.737579:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785219719.737585:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:3309:x1871938465046400:12345-0@lo:103: 00010000:00010000:0.0:1785219719.737595:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219719.737600:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf340031200/0x8b38d407a078c52b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c524 expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737615:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf340031200/0x8b38d407a078c52b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c524 expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737631:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737639:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1785219719.737652:0:5780:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001534796s 00010000:00010000:0.0:1785219719.737656:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737663:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737670:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737676:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737681:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219719.737685:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737692:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737700:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737718:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219719.737747:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:3309:x1871938465046400:12345-0@lo:103: Request processed in 161us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.737754:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785219719.737818:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465046400:0@lo:103: 00010000:00010000:0.0:1785219719.737847:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf340031200/0x8b38d407a078c52b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c524 expref: 12 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219719.737857:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1871938465046272:0@lo:104: 00010000:00010000:0.0:1785219719.737866:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737875:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737881:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219719.737886:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf340030200/0x8b38d407a078c5be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219719.747670:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:6584:x1871938465046144:12345-0@lo:253: Request processed in 136840us (136959us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219719.747684:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785219719.747763:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:6584:1871938465046144:0@lo:253: 10000000:01000000:2.0:1785219719.747778:0:6584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1785219719.747781:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785219719.747783:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785219719.747785:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219719.747786:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785219719.747787:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219719.747788:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219719.747790:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219719.747791:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785219719.747792:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785219719.747794:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219719.747795:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1785219719.747809:0:6584:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1785219719.753822:0:6584:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219719.754115:0:6584:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219719.754664:0:6584:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219719.754839:0:6584:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219719.755236:0:6584:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219719.758104:0:6584:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1785219719.760433:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1785219720.014308:0:6584:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1785219720.014316:0:6584:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1785219720.014351:0:6584:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1785219720.014447:0:6584:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1785219720.014463:0:6584:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1785219720.014491:0:6584:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:0.0:1785219720.250882:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785219720.250891:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf3503a5000 from 21 10000000:01000000:0.0:1785219720.250896:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785219720.250943:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.250954:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.250964:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219720.250998:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465046528:0@lo:101: 00000100:00100000:0.0:1785219720.251068:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.251122:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf349535480 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.251143:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046528 00000100:00100000:2.0:1785219720.251152:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046528 00000100:00100000:2.0:1785219720.251207:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785219720.251216:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:5790:x1871938465046528:12345-0@lo:101: 00010000:00010000:2.0:1785219720.251241:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219720.251255:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c5c5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.251279:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.251304:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.251313:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81a00, rc 0) 00000100:00100000:2.0:1785219720.251382:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465046528:12345-0@lo:101: Request processed in 166us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.251389:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1785219720.252335:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465046528:0@lo:101: 00010000:00010000:0.0:1785219720.252355:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.252390:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219720.252452:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465046656:0@lo:501: 00000100:00100000:0.0:1785219720.252490:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.252520:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf349535480 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.253029:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046656 00000100:00100000:2.0:1785219720.253036:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046656 00000100:00100000:2.0:1785219720.253208:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785219720.253217:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465046656:12345-0@lo:501: 00000100:00100000:2.0:1785219720.253807:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465046656:12345-0@lo:501: Request processed in 588us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.253816:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785219720.253943:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465046656:0@lo:501: 00000100:00100000:0.0:1785219720.254006:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465046784:0@lo:503: 00000100:00100000:0.0:1785219720.254054:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.254454:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf349535480 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.255179:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046784 00000100:00100000:2.0:1785219720.255187:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046784 00000100:00100000:2.0:1785219720.255400:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785219720.255411:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465046784:12345-0@lo:503: 00000100:00100000:2.0:1785219720.255733:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465046784:12345-0@lo:503: Request processed in 324us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.255741:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785219720.255802:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465046784:0@lo:503: 00000100:00100000:2.0:1785219720.256015:0:6623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6623:1871938465046912:0@lo:502: 00000100:00100000:2.0:1785219720.256056:0:6623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.256081:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465046912 00000100:00100000:2.0:1785219720.258237:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465046912 00000100:00100000:2.0:1785219720.258303:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785219720.258312:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6623:x1871938465046912:12345-0@lo:502: 00000100:00100000:2.0:1785219720.258640:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6623:x1871938465046912:12345-0@lo:502: Request processed in 327us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.258648:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785219720.258705:0:6623:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342cb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.258730:0:6623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6623:1871938465046912:0@lo:502: 00000100:00100000:2.0:1785219720.258795:0:6623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6623:1871938465047040:0@lo:502: 00000100:00100000:2.0:1785219720.258837:0:6623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.258864:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047040 00000100:00100000:2.0:1785219720.258869:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047040 00000100:00100000:2.0:1785219720.258891:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785219720.258898:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6623:x1871938465047040:12345-0@lo:502: 00000100:00100000:2.0:1785219720.259026:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:6623:x1871938465047040:12345-0@lo:502: Request processed in 128us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.259032:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785219720.259059:0:6623:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342cb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.259071:0:6623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6623:1871938465047040:0@lo:502: 00000040:00080000:2.0:1785219720.259102:0:6623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1785219720.259161:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1785219720.259177:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785219720.259186:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.259197:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219720.259218:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1785219720.259221:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf3503a5000 from 4 10000000:01000000:2.0:1785219720.259224:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785219720.259250:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.259258:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.259268:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219720.259281:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047168:0@lo:101: 00000100:00100000:2.0:1785219720.259305:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.259319:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342cb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.259331:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047168 00000100:00100000:2.0:1785219720.259334:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047168 00000100:00100000:2.0:1785219720.259355:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785219720.259360:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465047168:12345-0@lo:101: 00010000:00010000:2.0:1785219720.259388:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219720.259400:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c5d3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.259421:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.259431:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.259451:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:2.0:1785219720.259480:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465047168:12345-0@lo:101: Request processed in 119us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.259487:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785219720.259518:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047168:0@lo:101: 00010000:00010000:2.0:1785219720.259529:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.259537:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219720.259583:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047296:0@lo:256: 00000100:00100000:2.0:1785219720.259613:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.259626:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342cb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.259638:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047296 00000100:00100000:2.0:1785219720.259641:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047296 00000100:00100000:2.0:1785219720.259659:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785219720.259666:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465047296:12345-0@lo:256: 20000000:01000000:2.0:1785219720.260744:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785219720.260763:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785219720.260766:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1785219720.260873:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465047296:12345-0@lo:256: Request processed in 1205us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.260881:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1785219720.261027:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047296:0@lo:256: 10000000:01000000:0.0:1785219720.261094:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785219720.261103:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.261112:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219720.261121:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1785219720.261124:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1785219720.261127:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1785219720.261154:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.261162:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.261170:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219720.261186:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047424:0@lo:101: 00000100:00100000:0.0:1785219720.261215:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.261570:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf349535540 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.262454:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047424 00000100:00100000:2.0:1785219720.262464:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047424 00000100:00100000:2.0:1785219720.262530:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785219720.262538:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465047424:12345-0@lo:101: 00010000:00010000:2.0:1785219720.262552:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219720.262566:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c5e1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.262592:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.262602:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.262611:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81200, rc 0) 00000100:00100000:2.0:1785219720.262666:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465047424:12345-0@lo:101: Request processed in 128us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.262672:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785219720.262718:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047424:0@lo:101: 00010000:00010000:2.0:1785219720.262732:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.262741:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219720.262795:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047552:0@lo:501: 00000100:00100000:2.0:1785219720.262825:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.262842:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342cb0600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.262855:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047552 00000100:00100000:2.0:1785219720.262859:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047552 00000100:00100000:2.0:1785219720.262880:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785219720.262893:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465047552:12345-0@lo:501: 00000100:00100000:2.0:1785219720.265539:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465047552:12345-0@lo:501: Request processed in 2639us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.265553:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785219720.265560:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047552:0@lo:501: 00000100:00100000:0.0:1785219720.265618:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047680:0@lo:503: 00000100:00100000:0.0:1785219720.265675:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.265722:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf349535600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.266615:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047680 00000100:00100000:2.0:1785219720.266625:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047680 00000100:00100000:2.0:1785219720.266673:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785219720.266683:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465047680:12345-0@lo:503: 00000100:00100000:0.0:1785219720.267522:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465047680:0@lo:503: 00000100:00100000:2.0:1785219720.268541:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465047680:12345-0@lo:503: Request processed in 1856us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.268554:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1785219720.269106:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6624:1871938465047808:0@lo:502: 00000100:00100000:3.0:1785219720.269166:0:6624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.269204:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.269550:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047808 00000100:00100000:2.0:1785219720.269557:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047808 00000100:00100000:2.0:1785219720.269599:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1785219720.269607:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:6624:x1871938465047808:12345-0@lo:502: 00000100:00100000:2.0:1785219720.269887:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:6624:x1871938465047808:12345-0@lo:502: Request processed in 280us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.269895:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785219720.270430:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6624:1871938465047808:0@lo:502: 00000020:01000000:1.0:1785219720.270465:0:6624:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1785219720.270473:0:6624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1785219720.270482:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219720.270484:0:6624:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1785219720.270491:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1785219720.270496:0:6624:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1785219720.270518:0:6624:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1785219720.270521:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785219720.270544:0:6624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cf371a73380) 00000020:00000080:1.0:1785219720.270566:0:6624:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1785219720.270573:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1785219720.270652:0:6624:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1785219720.270658:0:6624:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1785219720.270665:0:6624:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078c5f6 00010000:00080000:1.0:1785219720.270696:0:6624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf36f4ad800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1785219720.270911:0:6624:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1785219720.324005:0:6624:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1785219720.324032:0:6624:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1785219720.324694:0:6624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219720.324851:0:6624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219720.324901:0:6624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1785219720.324962:0:6624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1785219720.341874:0:6629:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785219720.341881:0:6629:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1785219720.343191:0:6624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1785219720.343204:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1785219720.343236:0:6624:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1785219720.343257:0:6624:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078c5fd 00000100:00080000:3.0:1785219720.343270:0:6624:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785219720.343278:0:6624:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf36f4ad800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1785219720.343596:0:6624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf37e465180 x1871938465047936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785219720.343633:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465047936:0@lo:8: 00000100:00100000:3.0:1785219720.343714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1785219720.343782:0:6624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1785219720.343846:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465048192:0@lo:400: 00000100:00100000:3.0:1785219720.343890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.343917:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219720.343922:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465048064:0@lo:400: 00000100:00100000:3.0:1785219720.343950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.343982:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048192 00000100:00100000:3.0:1785219720.343998:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048192 00000100:00100000:3.0:1785219720.344046:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048064 00000100:00100000:3.0:1785219720.344050:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048064 00000100:00100000:3.0:1785219720.344066:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219720.344073:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465048192:12345-0@lo:400: 00000100:00100000:3.0:1785219720.344141:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465048192:12345-0@lo:400: Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219720.344149:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219720.344163:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219720.344168:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465048064:12345-0@lo:400: 00000100:00100000:3.0:1785219720.344201:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465048064:12345-0@lo:400: Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219720.344207:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1785219720.344233:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785219720.344266:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf37e466d80 x1871938465048064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219720.344280:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465048064:0@lo:400: 00010000:00080000:3.0:1785219720.344292:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf37e465880 x1871938465048192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219720.344301:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465048192:0@lo:400: 00000020:01000000:3.0:1785219720.344393:0:6624:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219720.344398:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219720.344400:0:6624:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1785219720.344403:0:6624:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219720.344407:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219720.344408:0:6624:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785219720.344411:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785219720.344413:0:6624:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1785219720.344436:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6624:1871938465048320:0@lo:502: 00000100:00100000:3.0:1785219720.344482:0:6624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.344508:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997600 going to sleep for 11 seconds 00000100:00100000:0.0:1785219720.344527:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048320 00000100:00100000:0.0:1785219720.344532:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048320 00000100:00100000:0.0:1785219720.344570:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785219720.344578:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:6624:x1871938465048320:12345-0@lo:502: 00000100:00100000:0.0:1785219720.344801:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:6624:x1871938465048320:12345-0@lo:502: Request processed in 223us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219720.344808:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785219720.344920:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465047936 00000100:00100000:1.0:1785219720.344925:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465047936 00000100:00100000:1.0:1785219720.344999:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219720.345004:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1871938465047936:12345-0@lo:8: 00010000:00080000:1.0:1785219720.345024:0:6586:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1785219720.345054:0:6586:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078c604 00002000:00100000:1.0:1785219720.345093:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cf381610000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cc ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1785219720.345098:0:6586:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1785219720.345101:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1785219720.345232:0:6586:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1785219720.345515:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1785219720.345540:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9cf381610800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219720.345599:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1871938465047936:12345-0@lo:8: Request processed in 592us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219720.345606:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785219720.346855:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf37e465180 x1871938465047936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785219730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219720.346869:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785219720.346878:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1785219720.346885:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1785219720.346890:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1785219720.346900:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf36f4ad800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1785219720.346915:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1785219720.346920:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465047936:0@lo:8: 00000100:00100000:3.0:1785219720.348356:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6624:1871938465048320:0@lo:502: 00000004:00080000:3.0:1785219720.348447:0:6629:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1785219720.348684:0:6629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213201318715ns, next at 0ns, rc = 0 00000020:01000000:3.0:1785219720.349956:0:6624:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219720.349969:0:6624:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219720.349971:0:6624:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1785219720.349977:0:6624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1785219720.350466:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1785219720.350487:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1785219720.350499:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.350511:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219720.350521:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785219720.350524:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf3503a5000 from 1 10000000:01000000:2.0:1785219720.350534:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785219720.350570:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.350578:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.350587:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219720.350608:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465048448:0@lo:101: 00000100:00100000:2.0:1785219720.350670:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.350865:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342cb0600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.350890:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048448 00000100:00100000:2.0:1785219720.350896:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048448 00000100:00100000:2.0:1785219720.350943:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1785219720.350952:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465048448:12345-0@lo:101: 00010000:00010000:2.0:1785219720.350966:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219720.350979:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c60b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.351013:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c60b expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.351024:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c60b expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.351032:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81600, rc 0) 00000100:00100000:2.0:1785219720.351187:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465048448:12345-0@lo:101: Request processed in 235us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219720.351204:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1785219720.361171:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465048448:0@lo:101: 00010000:00010000:3.0:1785219720.361200:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219720.361212:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219720.363451:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465048576:0@lo:501: 00000100:00100000:3.0:1785219720.363514:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.363559:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048576 00000100:00100000:3.0:1785219720.363565:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048576 00000100:00100000:3.0:1785219720.363607:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785219720.363616:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465048576:12345-0@lo:501: 00000100:00100000:2.0:1785219720.372463:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997600 going to sleep for 11 seconds 00000100:00100000:3.0:1785219720.376028:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465048576:12345-0@lo:501: Request processed in 12402us (12502us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219720.376044:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1785219720.379448:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465048576:0@lo:501: 00000100:00100000:2.0:1785219720.379535:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465048704:0@lo:503: 00000100:00100000:2.0:1785219720.379611:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.379655:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf36450f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219720.380084:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048704 00000100:00100000:0.0:1785219720.380092:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048704 00000100:00100000:0.0:1785219720.380140:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1785219720.380150:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465048704:12345-0@lo:503: 00000100:00100000:0.0:1785219720.381175:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465048704:12345-0@lo:503: Request processed in 1021us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219720.381187:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1785219720.381209:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465048704:0@lo:503: 00000100:00100000:0.0:1785219720.384772:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6632:1871938465048832:0@lo:502: 00000100:00100000:0.0:1785219720.384862:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.384911:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350f71e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785219720.386121:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048832 00000100:00100000:3.0:1785219720.386138:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048832 00000100:00100000:3.0:1785219720.386190:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785219720.386199:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:6632:x1871938465048832:12345-0@lo:502: 00000100:00100000:3.0:1785219720.386442:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:6632:x1871938465048832:12345-0@lo:502: Request processed in 243us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219720.386450:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785219720.388406:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6632:1871938465048832:0@lo:502: 00000020:01000000:0.0:1785219720.388451:0:6632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219720.388461:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219720.388463:0:6632:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785219720.388479:0:6632:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf3503a5000 00000020:00000080:0.0:1785219720.388483:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785219720.388522:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6632:1871938465048960:0@lo:502: 00000100:00100000:0.0:1785219720.388588:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.388627:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465048960 00000100:00100000:0.0:1785219720.388631:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465048960 00000100:00100000:0.0:1785219720.388679:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785219720.388689:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:6632:x1871938465048960:12345-0@lo:502: 00000100:00100000:0.0:1785219720.388873:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:6632:x1871938465048960:12345-0@lo:502: Request processed in 184us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219720.388881:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785219720.388931:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf349535900 going to sleep for 11 seconds 00000100:00100000:0.0:1785219720.388944:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:6632:1871938465048960:0@lo:502: 00000020:01000000:0.0:1785219720.388966:0:6632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219720.388970:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219720.388972:0:6632:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1785219720.388976:0:6632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1785219720.393785:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1785219720.393814:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785219720.393824:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.393838:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219720.393848:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1785219720.393851:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf3486699c0 from 1 10000000:01000000:2.0:1785219720.393854:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785219720.393891:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.393898:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219720.393909:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219720.393934:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465049088:0@lo:101: 00000100:00100000:2.0:1785219720.394023:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219720.394112:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219720.401110:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049088 00000100:00100000:0.0:1785219720.401127:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049088 00000100:00100000:0.0:1785219720.401189:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1785219720.401200:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465049088:12345-0@lo:101: 00010000:00010000:0.0:1785219720.401219:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219720.401238:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c619 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.401268:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c619 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.401281:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c619 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219720.401302:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030c00, rc 0) 00000100:00100000:0.0:1785219720.401411:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465049088:12345-0@lo:101: Request processed in 213us (7387us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219720.401418:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785219720.401642:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465049088:0@lo:101: 00010000:00010000:3.0:1785219720.401662:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219720.401673:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219720.402334:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465049216:0@lo:501: 00000100:00100000:3.0:1785219720.402802:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.402885:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219720.412717:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049216 00000100:00100000:1.0:1785219720.412732:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049216 00000100:00100000:1.0:1785219720.412880:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785219720.412899:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465049216:12345-0@lo:501: 00000100:00100000:1.0:1785219720.413310:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465049216:12345-0@lo:501: Request processed in 413us (10508us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785219720.413319:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1785219720.414342:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465049216:0@lo:501: 10000000:01000000:3.0:1785219720.414400:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1785219720.414410:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219720.414422:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785219720.420000:0:6630:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1785219720.420030:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049472:0@lo:7: 00000100:00100000:0.0:1785219720.420097:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.420138:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350f71180 going to sleep for 11 seconds 00000100:00100000:0.0:1785219720.420185:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465049344:0@lo:13: 00000100:00100000:0.0:1785219720.420220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219720.420396:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049472 00000100:00100000:1.0:1785219720.420404:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049472 00000100:00100000:1.0:1785219720.420454:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219720.420464:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6630:x1871938465049472:12345-0@lo:7: 00000100:00080000:0.0:1785219720.430435:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219720.430468:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049344 00000100:00100000:0.0:1785219720.430478:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049344 00000100:00100000:0.0:1785219720.430536:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219720.430549:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465049344:12345-0@lo:13: 00002000:00000024:0.0:1785219720.430575:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1785219720.430666:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465049344:12345-0@lo:13: Request processed in 120us (10444us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219720.430674:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1785219720.430814:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf348064a80 x1871938465049344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219720.430838:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465049344:0@lo:13: 00002000:00080000:3.0:1785219720.434487:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1785219720.434495:0:6589:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1785219720.434589:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6630:x1871938465049472:12345-0@lo:7: Request processed in 14122us (14487us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219720.434611:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1785219720.434744:0:6630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf348065500 x1871938465049472/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785219736 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219720.434760:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049472:0@lo:7: 00000004:00080000:0.0:1785219720.434780:0:6630:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1785219720.434815:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049600:0@lo:5: 00000100:00100000:0.0:1785219720.434847:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219720.434891:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350f71180 going to sleep for 11 seconds 00000100:00100000:3.0:1785219720.439146:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049600 00000100:00100000:3.0:1785219720.439160:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049600 00000100:00100000:3.0:1785219720.439220:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219720.439231:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6630:x1871938465049600:12345-0@lo:5: 00002000:00080000:3.0:1785219720.439261:0:6586:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1785219720.439265:0:6586:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1785219720.440748:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6630:x1871938465049600:12345-0@lo:5: Request processed in 1515us (5896us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1785219720.440758:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1785219720.440811:0:6630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf348065500 x1871938465049600/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785219736 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219720.440828:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049600:0@lo:5: 00000004:00080000:3.0:1785219720.440840:0:6630:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1785219720.440872:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049728:0@lo:700: 00000100:00100000:3.0:1785219720.440899:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.443642:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.448862:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049728 00000100:00100000:2.0:1785219720.448875:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049728 00000100:00100000:2.0:1785219720.448923:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785219720.448933:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6630:x1871938465049728:12345-0@lo:700: 00000100:00100000:2.0:1785219720.449139:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6595:1871938465049856:0@lo:700: 00000100:00100000:2.0:1785219720.449204:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219720.449235:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049856 00000100:00100000:3.0:1785219720.449240:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049856 00000100:00100000:2.0:1785219720.450052:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4e3780 going to sleep for 11 seconds 00000100:00100000:3.0:1785219720.450238:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219720.450248:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:6595:x1871938465049856:12345-0@lo:700: 00000004:00080000:0.0:1785219720.465771:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1785219720.556469:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1785219720.564309:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1785219720.574283:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:6595:x1871938465049856:12345-0@lo:700: Request processed in 124030us (125071us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219720.574301:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1785219720.578765:0:6595:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36dc00a80 x1871938465049856/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785219736 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219720.578784:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6595:1871938465049856:0@lo:700: 40000000:02000000:2.0:1785219720.578801:0:6595:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1785219720.719519:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6630:x1871938465049728:12345-0@lo:700: Request processed in 270578us (278609us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219720.719551:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1785219720.719658:0:6630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf37e465180 x1871938465049728/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785219736 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219720.719675:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049728:0@lo:700: 00000001:00100000:0.0:1785219720.722290:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1785219720.722311:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:1.0:1785219720.740831:0:6630:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1785219720.746292:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049984:0@lo:5: 00000100:00100000:1.0:1785219720.746467:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219720.746515:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf244af5780 going to sleep for 11 seconds 00000100:00100000:2.0:1785219720.749508:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465049984 00000100:00100000:2.0:1785219720.749523:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465049984 00000100:00100000:2.0:1785219720.751237:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785219720.751255:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6630:x1871938465049984:12345-0@lo:5: 00002000:00080000:2.0:1785219720.762697:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1785219720.762719:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1785219720.766786:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6630:x1871938465049984:12345-0@lo:5: Request processed in 15531us (20313us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1785219720.766800:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1785219720.766891:0:6630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf0bb80 x1871938465049984/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785219736 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219720.766919:0:6630:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1785219720.766935:0:6630:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9cf36cf0bb80 x1871938465049984/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785219736 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219720.766946:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6630:1871938465049984:0@lo:5: 00000004:00080000:3.0:1785219720.766961:0:6630:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1785219721.580763:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219722.604219:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219723.646835:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219724.652892:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219725.675589:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219725.740792:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465050112:0@lo:400: 00000100:00100000:1.0:1785219725.740875:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219725.740927:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785219725.740933:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465050496:0@lo:400: 00000100:00100000:1.0:1785219725.740968:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219725.740997:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465050240:0@lo:400: 00000100:00100000:1.0:1785219725.741035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219725.741056:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219725.741061:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465050368:0@lo:400: 00000100:00100000:1.0:1785219725.741080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219725.741111:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465050112 00000100:00100000:1.0:1785219725.741117:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465050112 00000100:00100000:1.0:1785219725.741153:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785219725.741161:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3309:x1871938465050112:12345-0@lo:400: 00000100:00100000:1.0:1785219725.741206:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3309:x1871938465050112:12345-0@lo:400: Request processed in 46us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219725.741213:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785219725.741243:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465050496 00000100:00100000:1.0:1785219725.741247:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465050496 00000100:00100000:1.0:1785219725.741278:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219725.741294:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1871938465050496:12345-0@lo:400: 00000100:00100000:1.0:1785219725.741335:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1871938465050496:12345-0@lo:400: Request processed in 41us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219725.741341:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785219725.741358:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465050240 00000100:00100000:1.0:1785219725.741382:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465050240 00000100:00100000:1.0:1785219725.741406:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465050368 00000100:00100000:1.0:1785219725.741408:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465050368 00000100:00100000:1.0:1785219725.741423:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785219725.741428:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465050240:12345-0@lo:400: 00000100:00100000:1.0:1785219725.741462:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465050240:12345-0@lo:400: Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219725.741467:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785219725.741478:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785219725.741490:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465050368:12345-0@lo:400: 00000100:00100000:1.0:1785219725.741517:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465050368:12345-0@lo:400: Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219725.741522:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1785219725.741544:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785219725.741548:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785219725.741576:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf09f80 x1871938465050368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219725.741590:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465050368:0@lo:400: 00010000:00080000:1.0:1785219725.741600:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf08700 x1871938465050240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219725.741608:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465050240:0@lo:400: 00010000:00080000:1.0:1785219725.741638:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf0aa00 x1871938465050496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219725.741646:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465050496:0@lo:400: 00000100:00100000:1.0:1785219725.741654:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465050112:0@lo:400: 00000100:00100000:2.0:1785219725.748128:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219725.748154:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465050624:0@lo:13: 00000100:00100000:2.0:1785219725.748223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219725.748301:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465050624 00000100:00100000:2.0:1785219725.748309:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465050624 00000100:00100000:2.0:1785219725.748350:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219725.748357:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465050624:12345-0@lo:13: 00002000:00000024:2.0:1785219725.748405:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219725.748442:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465050624:12345-0@lo:13: Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219725.748449:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785219725.748483:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36dc00a80 x1871938465050624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219725.748499:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465050624:0@lo:13: 00000001:02000400:2.0:1785219725.813183:0:6961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:0.0:1785219725.821447:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1785219726.703693:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219727.725386:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219728.759298:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219729.775835:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219730.806396:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219730.859748:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465051136:0@lo:400: 00000100:00100000:0.0:1785219730.859820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219730.859885:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785219730.859892:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465051008:0@lo:400: 00000100:00100000:0.0:1785219730.859956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219730.860346:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465050752:0@lo:400: 00000100:00100000:1.0:1785219730.860423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219730.860447:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219730.860453:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465050880:0@lo:400: 00000100:00100000:1.0:1785219730.860476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219730.860509:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051008 00000100:00100000:1.0:1785219730.860516:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051008 00000100:00100000:1.0:1785219730.860646:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465050880 00000100:00100000:1.0:1785219730.860658:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465050880 00000100:00100000:1.0:1785219730.860681:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785219730.860689:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465051008:12345-0@lo:400: 00000100:00100000:1.0:1785219730.860746:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465051008:12345-0@lo:400: Request processed in 57us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219730.860753:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785219730.860770:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785219730.860776:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465050880:12345-0@lo:400: 00000100:00100000:1.0:1785219730.860808:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465050880:12345-0@lo:400: Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219730.860814:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219730.860935:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465050752 00000100:00100000:0.0:1785219730.860939:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465050752 00000100:00080000:1.0:1785219730.860976:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219730.862331:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051136 00000100:00100000:2.0:1785219730.862341:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051136 00000100:00100000:3.0:1785219730.862485:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219730.862500:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465051264:0@lo:13: 00000100:00100000:3.0:1785219730.862766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219730.862929:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785219730.862941:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3306:x1871938465050752:12345-0@lo:400: 00000100:00100000:0.0:1785219730.862983:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3306:x1871938465050752:12345-0@lo:400: Request processed in 46us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219730.862989:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1785219730.863407:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf348066a00 x1871938465050880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219730.863423:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465050880:0@lo:400: 00000100:00100000:1.0:1785219730.863436:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465050752:0@lo:400: 00010000:00080000:1.0:1785219730.863480:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf348065880 x1871938465051008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219730.863490:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465051008:0@lo:400: 00000100:00100000:2.0:1785219730.863767:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219730.863776:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465051136:12345-0@lo:400: 00000100:00100000:2.0:1785219730.863822:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465051136:12345-0@lo:400: Request processed in 48us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219730.863829:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1785219730.864770:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785219730.864805:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf348067100 x1871938465051136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219730.864815:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1785219730.864826:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465051136:0@lo:400: 00000100:00100000:3.0:1785219730.865235:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051264 00000100:00100000:3.0:1785219730.865256:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051264 00000100:00100000:3.0:1785219730.865297:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219730.865304:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465051264:12345-0@lo:13: 00002000:00000024:3.0:1785219730.865334:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219730.865407:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465051264:12345-0@lo:13: Request processed in 103us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219730.865413:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1785219730.865445:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf37e464700 x1871938465051264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219730.865460:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465051264:0@lo:13: 00010000:00010000:3.0:1785219731.821157:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219732.844522:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219733.875653:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219734.892886:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1785219735.907168:0:7475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785219735.907172:0:7475:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1785219735.907532:0:7475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9cf37e4b1000 00000020:01000004:3.0:1785219735.907554:0:7475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1785219735.907567:0:7475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1785219735.907581:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cf349c53380) 00000020:00000080:3.0:1785219735.907599:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1785219735.915782:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1785219735.941397:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1785219735.941812:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1785219735.962934:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1785219735.967969:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1785219735.968003:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1785219735.968059:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785219735.968094:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1785219735.968778:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1785219735.968791:0:7475:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785219735.968801:0:7475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8b38d407a078c62e 00000020:01000004:3.0:1785219735.968809:0:7475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1785219735.968831:0:7475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785219735.968834:0:7475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785219735.968840:0:7475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1785219735.968861:0:7475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1785219735.968865:0:7475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:2.0:1785219735.979816:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465051392:0@lo:400: 00000100:00100000:2.0:1785219735.979902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219735.979960:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785219735.979967:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465051776:0@lo:400: 00000100:00100000:2.0:1785219735.979993:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219735.980018:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465051520:0@lo:400: 00000100:00100000:2.0:1785219735.980054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219735.980073:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219735.980079:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465051648:0@lo:400: 00000100:00100000:2.0:1785219735.980101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219735.980219:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051392 00000100:00100000:1.0:1785219735.980228:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051392 00000100:00100000:1.0:1785219735.980273:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785219735.980282:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3307:x1871938465051392:12345-0@lo:400: 00000100:00100000:1.0:1785219735.980338:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3307:x1871938465051392:12345-0@lo:400: Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219735.980346:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785219735.980591:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051776 00000100:00100000:1.0:1785219735.980596:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051776 00000100:00100000:1.0:1785219735.980630:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219735.980636:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465051776:12345-0@lo:400: 00000100:00100000:1.0:1785219735.980669:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465051776:12345-0@lo:400: Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219735.980674:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219735.980692:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051520 00000100:00100000:1.0:1785219735.980695:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051520 00000100:00100000:1.0:1785219735.980717:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051648 00000100:00100000:1.0:1785219735.980720:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051648 00000100:00100000:1.0:1785219735.980735:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785219735.980740:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465051520:12345-0@lo:400: 00000100:00100000:1.0:1785219735.980776:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465051520:12345-0@lo:400: Request processed in 36us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219735.980782:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785219735.980792:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785219735.980797:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465051648:12345-0@lo:400: 00000100:00100000:1.0:1785219735.980819:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465051648:12345-0@lo:400: Request processed in 23us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219735.980832:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1785219735.980853:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785219735.980857:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785219735.980900:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36dc01f80 x1871938465051648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219735.980914:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465051648:0@lo:400: 00010000:00080000:1.0:1785219735.980925:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36dc00700 x1871938465051520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219735.980933:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465051520:0@lo:400: 00010000:00080000:1.0:1785219735.980974:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36dc03b80 x1871938465051776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219735.980983:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465051776:0@lo:400: 00000100:00100000:1.0:1785219735.980992:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465051392:0@lo:400: 00000100:00100000:1.0:1785219735.983699:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219735.983724:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465051904:0@lo:13: 00000100:00100000:1.0:1785219735.983787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219735.983841:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465051904 00000100:00100000:1.0:1785219735.983848:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465051904 00000100:00100000:1.0:1785219735.983902:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785219735.983911:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465051904:12345-0@lo:13: 00002000:00000024:1.0:1785219735.983942:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219735.983985:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465051904:12345-0@lo:13: Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219735.983992:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1785219735.984040:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf0bb80 x1871938465051904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219735.984058:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465051904:0@lo:13: 00000040:01000000:3.0:1785219735.990587:0:7475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1785219735.990618:0:7475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1785219735.990622:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1785219735.990624:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785219735.990625:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219735.990626:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219735.990628:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219735.990629:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219735.990630:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785219735.990632:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219735.990633:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219735.990634:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219735.990635:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219735.990642:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1785219735.990644:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785219735.990645:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785219735.990646:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219735.990647:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219735.990648:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219735.990649:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219735.990650:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785219735.990651:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785219735.990652:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785219735.990653:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219735.990654:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219735.990681:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1785219735.990697:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465052032:0@lo:253: 00000100:00100000:3.0:1785219735.990757:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219735.990788:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2458bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1785219735.990937:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052032 00000100:00100000:1.0:1785219735.990944:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052032 00000100:00100000:1.0:1785219735.990993:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785219735.991002:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:7475:x1871938465052032:12345-0@lo:253: 20000000:01000000:1.0:1785219735.991041:0:5787:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1785219735.991045:0:5787:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1785219735.991049:0:5787:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1785219735.991052:0:5787:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1785219735.992254:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219735.993799:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1785219735.993823:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1785219735.993893:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1785219735.993902:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1785219735.993939:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1785219735.993991:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1785219735.994435:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1785219735.994457:0:5787:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:1.0:1785219735.994459:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:1.0:1785219735.994744:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1785219735.994753:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1785219735.994798:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1785219735.994805:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:1.0:1785219735.994833:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1785219735.994841:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1785219735.994870:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1785219735.994932:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1785219735.995844:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1785219735.995873:0:5787:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.131@tcp 20000000:01000000:1.0:1785219735.995875:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.131@tcp (null) (null) (null) 00000040:00080000:1.0:1785219735.995937:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1785219735.995945:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1785219735.995978:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1785219735.995986:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.131@tcp (null) (null) 00000040:00080000:1.0:1785219735.996018:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1785219735.996026:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1785219735.996073:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1785219735.996114:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1785219735.996131:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1785219735.996134:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1785219735.996140:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1785219735.996141:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1785219735.996144:0:5787:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1785219735.996154:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1785219735.996156:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1785219735.996187:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1785219735.996190:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1785219735.996924:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1785219735.998834:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1785219735.998894:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1785219735.998964:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1785219735.998977:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1785219735.998980:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785219735.999701:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1785219735.999756:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1785219735.999807:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1785219736.000065:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1785219736.000106:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1785219736.000185:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1785219736.000197:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1785219736.000200:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785219736.001045:0:7479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1785219736.001099:0:7479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1785219736.001155:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1785219736.001613:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1785219736.001656:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1785219736.001689:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1785219736.001701:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1785219736.001704:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785219736.002396:0:7480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1785219736.002594:0:7480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1785219736.002630:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1785219736.003127:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1785219736.003169:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1785219736.003317:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1785219736.003338:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1785219736.003358:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.003675:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c571 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.003682:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c59b expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.003689:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.003694:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.003701:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c619 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.003707:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.003821:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c619 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.003846:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c619 expref: 16 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.003861:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052160:0@lo:104: 00000100:00100000:1.0:1785219736.003942:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785219736.004030:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.004040:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 16 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.004048:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052288:0@lo:104: 00010000:00010000:1.0:1785219736.004072:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.004080:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 16 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.004087:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052416:0@lo:104: 00010000:00010000:1.0:1785219736.004110:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c59b expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.004116:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c59b expref: 16 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.004123:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052544:0@lo:104: 00010000:00010000:1.0:1785219736.004145:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c571 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.004164:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c578 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c571 expref: 16 pid: 5785 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.004172:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052672:0@lo:104: 00000100:00100000:1.0:1785219736.004203:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.004318:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1785219736.004337:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219736.004465:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219736.004676:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.004726:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052160 00000100:00100000:0.0:1785219736.004735:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052160 00000100:00100000:0.0:1785219736.004768:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052288 00000100:00100000:0.0:1785219736.004771:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052288 00000100:00100000:0.0:1785219736.004782:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052416 00000100:00100000:0.0:1785219736.004784:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052416 00000100:00100000:0.0:1785219736.004797:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219736.004816:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf34872f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:5787:x1871938465052160:12345-0@lo:104: 00010000:00010000:0.0:1785219736.004830:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.004941:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785219736.004947:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf34872f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:5787:x1871938465052160:12345-0@lo:104: Request processed in 144us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219736.004955:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219736.004999:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219736.005005:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+4:5787:x1871938465052288:12345-0@lo:104: 00010000:00010000:0.0:1785219736.005012:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005048:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1785219736.005053:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+4:5787:x1871938465052288:12345-0@lo:104: Request processed in 49us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219736.005059:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219736.005070:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785219736.005075:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5787:x1871938465052416:12345-0@lo:104: 00010000:00010000:0.0:1785219736.005082:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005106:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1785219736.005110:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5787:x1871938465052416:12345-0@lo:104: Request processed in 36us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219736.005115:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1785219736.005132:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785219736.005137:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005145:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81c00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219736.005155:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005163:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219736.005170:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219736.005176:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219736.005216:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005223:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219736.005239:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005246:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f81c00/0x8b38d407a078c619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c620 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005259:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785219736.005262:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005268:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031200 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219736.005270:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005277:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219736.005293:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219736.005298:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219736.005311:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005317:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219736.005323:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005329:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c5e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5e8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005340:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219736.005343:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005348:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219736.005350:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005357:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219736.005395:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219736.005412:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219736.005432:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005438:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219736.005452:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005459:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c5c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.005469:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219736.005471:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219736.005799:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219736.005920:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052160:0@lo:104: 00010000:00010000:1.0:1785219736.005932:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219736.005946:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465052800:0@lo:103: 00000100:00100000:1.0:1785219736.005985:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.006028:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785219736.006034:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465052928:0@lo:103: 00000100:00100000:1.0:1785219736.006055:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.006088:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465053056:0@lo:103: 00000100:00100000:1.0:1785219736.006107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.006141:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052800 00000100:00100000:1.0:1785219736.006146:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052800 00010000:00010000:1.0:1785219736.006168:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c619 expref: 17 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.006190:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052928 00000100:00100000:1.0:1785219736.006192:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052928 00010000:00010000:1.0:1785219736.006203:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 18 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219736.006306:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219736.006317:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052544 00000100:00100000:2.0:1785219736.006321:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052544 00000100:00100000:2.0:1785219736.006341:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465052672 00000100:00100000:2.0:1785219736.006343:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465052672 00000100:00100000:2.0:1785219736.006354:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785219736.006360:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:5787:x1871938465052544:12345-0@lo:104: 00010000:00010000:2.0:1785219736.006387:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006436:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785219736.006440:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:5787:x1871938465052544:12345-0@lo:104: Request processed in 81us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.006447:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785219736.006461:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785219736.006467:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5787:x1871938465052672:12345-0@lo:104: 00010000:00010000:2.0:1785219736.006483:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006516:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785219736.006521:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5787:x1871938465052672:12345-0@lo:104: Request processed in 54us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.006535:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1785219736.006549:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785219736.006554:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006560:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219736.006564:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006571:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219736.006578:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219736.006583:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785219736.006604:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006610:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219736.006621:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006627:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078c59b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5a2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006641:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219736.006644:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006659:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341477000 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219736.006662:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006668:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219736.006674:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219736.006679:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785219736.006691:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006696:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219736.006706:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006712:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c571 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c578 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.006728:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219736.006730:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219736.006731:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219736.006918:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053056 00000100:00100000:0.0:1785219736.006923:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053056 00010000:00010000:0.0:1785219736.006940:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 19 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219736.006956:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219736.006963:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465052800:12345-0@lo:103: 00010000:00010000:0.0:1785219736.006973:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219736.006979:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c619 expref: 19 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.006989:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c619 expref: 19 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.007002:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf340030c00/0x8b38d407a078c620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c619 expref: 19 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.007017:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219736.008119:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:3308:x1871938465052800:12345-0@lo:103: Request processed in 1152us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219736.008131:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219736.008159:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219736.008167:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:3306:x1871938465053056:12345-0@lo:103: 00010000:00010000:0.0:1785219736.008179:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219736.008185:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 17 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.008196:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 17 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.008220:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219736.008245:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:3306:x1871938465053056:12345-0@lo:103: Request processed in 80us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219736.008251:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785219736.008495:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785219736.008506:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3308:x1871938465052928:12345-0@lo:103: 00010000:00010000:1.0:1785219736.008514:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219736.008529:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 16 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.008538:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 16 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.008548:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219736.008575:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3308:x1871938465052928:12345-0@lo:103: Request processed in 74us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.008581:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1785219736.008607:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219736.008625:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465053184:0@lo:103: 00000100:00100000:1.0:1785219736.008661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.008789:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465053056:0@lo:103: 00000100:00100000:1.0:1785219736.008816:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465053312:0@lo:103: 00000100:00100000:1.0:1785219736.008838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.009040:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465052928:0@lo:103: 00000100:00100000:1.0:1785219736.009049:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465052800:0@lo:103: 00010000:00010000:1.0:1785219736.009081:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c5e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c5e1 expref: 15 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.009093:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052288:0@lo:104: 00010000:00010000:1.0:1785219736.009103:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c5cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c5c5 expref: 14 pid: 5788 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.009110:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052416:0@lo:104: 00000100:00100000:1.0:1785219736.009118:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052544:0@lo:104: 00000100:00100000:1.0:1785219736.009133:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5787:1871938465052672:0@lo:104: 00010000:00010000:1.0:1785219736.009159:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219736.009290:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053184 00000100:00100000:2.0:1785219736.009297:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053184 00010000:00010000:2.0:1785219736.009321:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c59b expref: 14 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219736.009389:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053312 00000100:00100000:2.0:1785219736.009399:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053312 00010000:00010000:2.0:1785219736.009423:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c578 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c571 expref: 15 pid: 5785 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219736.009470:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785219736.009480:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+15:3307:x1871938465053184:12345-0@lo:103: 00010000:00010000:0.0:1785219736.009490:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219736.009495:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c59b expref: 15 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009505:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c59b expref: 15 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009517:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c5a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c59b expref: 15 pid: 5787 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009530:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219736.009574:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:3307:x1871938465053184:12345-0@lo:103: Request processed in 96us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219736.009580:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785219736.009597:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785219736.009602:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:3308:x1871938465053312:12345-0@lo:103: 00010000:00010000:0.0:1785219736.009610:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219736.009615:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c578 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c571 expref: 13 pid: 5785 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009623:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c571 expref: 13 pid: 5785 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009632:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c571 expref: 13 pid: 5785 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009644:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009654:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009667:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009674:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009681:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009687:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009700:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219736.009704:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009712:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009725:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.009734:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219736.009759:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:3308:x1871938465053312:12345-0@lo:103: Request processed in 157us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219736.009766:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785219736.009974:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465053184:0@lo:103: 00000100:00100000:1.0:1785219736.010000:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465053312:0@lo:103: 00010000:00010000:1.0:1785219736.010014:0:5787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.010021:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.010029:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c635 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785219736.010043:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1785219736.051191:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+11:7475:x1871938465052032:12345-0@lo:253: Request processed in 60183us (60425us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.051216:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785219736.051398:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465052032:0@lo:253: 10000000:01000000:2.0:1785219736.051485:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1785219736.051489:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785219736.051491:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785219736.051492:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219736.051493:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1785219736.051494:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219736.051496:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219736.051497:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219736.051499:0:7475:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1785219736.051501:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219736.051502:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1785219736.051525:0:7475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf37e4b1000 from lustre-OST0001 10000000:01000000:2.0:1785219736.051551:0:7475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1785219736.051554:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1785219736.051561:0:7475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf3486699c0 local copy 10000000:01000000:2.0:1785219736.051566:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785219736.051604:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.051614:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.051622:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219736.051639:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053440:0@lo:101: 00000100:00100000:2.0:1785219736.051674:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219736.051713:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351d71f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219736.051786:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053440 00000100:00100000:1.0:1785219736.051792:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053440 00000100:00100000:1.0:1785219736.051835:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1785219736.051842:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+11:7475:x1871938465053440:12345-0@lo:101: 00010000:00010000:1.0:1785219736.051854:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219736.051868:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341476800/0x8b38d407a078c643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c63c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.051901:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341476800/0x8b38d407a078c643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c63c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.051917:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341476800/0x8b38d407a078c643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c63c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.051927:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476800, rc 0) 00000100:00100000:1.0:1785219736.052018:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465053440:12345-0@lo:101: Request processed in 175us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.052024:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785219736.052164:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053440:0@lo:101: 00010000:00010000:0.0:1785219736.052178:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.052186:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219736.052353:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053568:0@lo:501: 00000100:00100000:0.0:1785219736.052531:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.052596:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575a600 going to sleep for 11 seconds 00000100:00100000:1.0:1785219736.052637:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053568 00000100:00100000:1.0:1785219736.052642:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053568 00000100:00100000:1.0:1785219736.052708:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785219736.052716:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465053568:12345-0@lo:501: 00000100:00100000:1.0:1785219736.052967:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465053568:12345-0@lo:501: Request processed in 251us (436us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785219736.052974:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1785219736.053045:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053568:0@lo:501: 10000000:01000000:0.0:1785219736.053059:0:7475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1785219736.053085:0:7475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1785219736.053098:0:7475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.053105:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.053111:0:7475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.053133:0:7475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785219736.053152:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf37e4b1000 10000000:01000000:0.0:1785219736.053157:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1785219736.053161:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1785219736.053164:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785219736.053168:0:7475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1785219736.053171:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1785219736.053189:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.053197:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.053205:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.053298:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219736.053305:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.053313:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81a00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219736.053317:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.053325:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219736.053331:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219736.053337:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785219736.053356:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.053381:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219736.053417:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.053425:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f81a00/0x8b38d407a078c63c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8b38d407a078c643 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.053438:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219736.053440:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219736.053442:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219736.053546:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465053824:0@lo:103: 00000100:00100000:3.0:1785219736.053581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219736.053656:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053824 00000100:00100000:2.0:1785219736.053660:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053824 00000100:00100000:2.0:1785219736.053699:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219736.053706:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:3309:x1871938465053824:12345-0@lo:103: 00010000:00010000:2.0:1785219736.053722:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219736.053734:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341476800/0x8b38d407a078c643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c63c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.053748:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219736.053777:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:3309:x1871938465053824:12345-0@lo:103: Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.053782:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785219736.053845:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465053824:0@lo:103: 00000100:00100000:0.0:1785219736.053928:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053696:0@lo:101: 00000100:00100000:0.0:1785219736.053954:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.053973:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575af00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.054016:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053696 00000100:00100000:2.0:1785219736.054020:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053696 00000100:00100000:2.0:1785219736.054050:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785219736.054057:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+11:7475:x1871938465053696:12345-0@lo:101: 00010000:00010000:2.0:1785219736.054066:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219736.054078:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c64a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.054096:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c64a expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.054105:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c64a expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.054112:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81200, rc 0) 00000100:00100000:2.0:1785219736.054146:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465053696:12345-0@lo:101: Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.054152:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785219736.054325:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053696:0@lo:101: 00010000:00010000:0.0:1785219736.054337:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.054353:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219736.054524:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053952:0@lo:501: 00000100:00100000:0.0:1785219736.054549:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.054564:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575af00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.054638:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465053952 00000100:00100000:2.0:1785219736.054642:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465053952 00000100:00100000:2.0:1785219736.054709:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785219736.054723:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465053952:12345-0@lo:501: 00000100:00100000:2.0:1785219736.054939:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465053952:12345-0@lo:501: Request processed in 216us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.054946:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1785219736.055035:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465053952:0@lo:501: 00000100:00100000:0.0:1785219736.055062:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054080:0@lo:503: 00000100:00100000:0.0:1785219736.055098:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.055126:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575af00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.055169:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054080 00000100:00100000:2.0:1785219736.055173:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054080 00000100:00100000:2.0:1785219736.055189:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785219736.055195:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465054080:12345-0@lo:503: 00000100:00100000:2.0:1785219736.055340:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465054080:12345-0@lo:503: Request processed in 144us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.055346:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785219736.055567:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054080:0@lo:503: 00000040:00080000:0.0:1785219736.055925:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785219736.055996:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054208:0@lo:502: 00000100:00100000:0.0:1785219736.056031:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.056061:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575af00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.056346:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054208 00000100:00100000:2.0:1785219736.056351:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054208 00000100:00100000:2.0:1785219736.056551:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1785219736.056559:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465054208:12345-0@lo:502: 00000100:00100000:2.0:1785219736.056725:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465054208:12345-0@lo:502: Request processed in 166us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.056733:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785219736.056810:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054208:0@lo:502: 00000040:00080000:0.0:1785219736.057063:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1785219736.057111:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1785219736.057144:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1785219736.057203:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1785219736.057254:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1785219736.057292:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1785219736.057318:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054336:0@lo:502: 00000100:00100000:0.0:1785219736.057355:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.057528:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575af00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219736.057603:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054336 00000100:00100000:1.0:1785219736.057608:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054336 00000100:00100000:1.0:1785219736.057631:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1785219736.057636:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465054336:12345-0@lo:502: 00000100:00100000:1.0:1785219736.057785:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465054336:12345-0@lo:502: Request processed in 147us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.057791:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1785219736.057974:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054336:0@lo:502: 00000040:00080000:0.0:1785219736.058057:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1785219736.058067:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1785219736.058726:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785219736.058736:0:7483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1785219736.058742:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219736.058744:0:7483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1785219736.058749:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785219736.058763:0:7483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cf348068000) 00000020:00000080:0.0:1785219736.058785:0:7483:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1785219736.058791:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1785219736.058859:0:7483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf37e4b1000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1785219736.058867:0:7483:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785219736.058873:0:7483:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8b38d407a078c65f 00010000:00010000:1.0:1785219736.066628:0:7483:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1785219736.066961:0:7483:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1785219736.070129:0:7483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1785219736.070456:0:7483:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1785219736.074899:0:7483:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1785219736.075571:0:7483:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1785219736.077192:0:7483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1785219736.077205:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219736.077219:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219736.077221:0:7483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1785219736.077225:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219736.077228:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219736.077230:0:7483:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1785219736.077233:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1785219736.077235:0:7483:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1785219736.077287:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219736.077291:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219736.077293:0:7483:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1785219736.077295:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1785219736.080533:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1785219736.080575:0:7475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1785219736.080597:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.080610:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219736.080618:0:7475:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf37e4b1000 from 1 10000000:01000000:0.0:1785219736.080621:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785219736.080662:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.080669:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.080679:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219736.080712:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054464:0@lo:101: 00000100:00100000:0.0:1785219736.080783:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.080825:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219736.081352:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054464 00000100:00100000:1.0:1785219736.081385:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054464 00000100:00100000:1.0:1785219736.081544:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1785219736.081553:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+12:7475:x1871938465054464:12345-0@lo:101: 00010000:00010000:1.0:1785219736.081567:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219736.081581:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c666 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.081605:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c666 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.081616:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c666 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.081625:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476800, rc 0) 00000100:00100000:1.0:1785219736.081768:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054464:12345-0@lo:101: Request processed in 216us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.081786:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1785219736.086542:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054464:0@lo:101: 00010000:00010000:0.0:1785219736.086575:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219736.086587:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219736.086811:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054592:0@lo:501: 00000100:00100000:0.0:1785219736.086875:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.087696:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.088618:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054592 00000100:00100000:2.0:1785219736.088628:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054592 00000100:00100000:2.0:1785219736.088788:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1785219736.088799:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054592:12345-0@lo:501: 00000100:00100000:2.0:1785219736.089097:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054592:12345-0@lo:501: Request processed in 300us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.089105:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785219736.089182:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054592:0@lo:501: 00000100:00100000:0.0:1785219736.089236:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054720:0@lo:503: 00000100:00100000:0.0:1785219736.089282:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.089657:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219736.089692:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054720 00000100:00100000:3.0:1785219736.089789:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054720 00000100:00100000:3.0:1785219736.089829:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785219736.089836:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054720:12345-0@lo:503: 00000100:00100000:3.0:1785219736.091320:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054720:12345-0@lo:503: Request processed in 1478us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219736.091333:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1785219736.091609:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054720:0@lo:503: 00000040:00080000:0.0:1785219736.091979:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785219736.092062:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054848:0@lo:502: 00000100:00100000:0.0:1785219736.092110:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219736.092188:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219736.092291:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054848 00000100:00100000:3.0:1785219736.092297:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054848 00000100:00100000:3.0:1785219736.092477:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1785219736.092487:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054848:12345-0@lo:502: 00000100:00100000:3.0:1785219736.092672:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054848:12345-0@lo:502: Request processed in 185us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219736.092678:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785219736.092765:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054848:0@lo:502: 00000040:00080000:0.0:1785219736.093030:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1785219736.093089:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1785219736.093116:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054976:0@lo:502: 00000100:00100000:0.0:1785219736.093152:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.094118:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465054976 00000100:00100000:1.0:1785219736.094127:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465054976 00000100:00100000:1.0:1785219736.094163:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1785219736.094171:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054976:12345-0@lo:502: 00000100:00100000:1.0:1785219736.094392:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465054976:12345-0@lo:502: Request processed in 194us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.094525:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1785219736.094630:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35575acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219736.094652:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465054976:0@lo:502: 00000040:00080000:0.0:1785219736.094778:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1785219736.094792:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1785219736.095393:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219736.095413:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219736.095416:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785219736.095423:0:7487:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf37e4b1000 00000020:00000080:0.0:1785219736.095425:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785219736.095446:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219736.095450:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219736.095451:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1785219736.095454:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1785219736.095632:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1785219736.095656:0:7475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785219736.095676:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.095688:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219736.095736:0:7475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1785219736.095739:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf37e4b1000 10000000:01000000:1.0:1785219736.095743:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf37e4b1000 10000000:01000000:1.0:1785219736.095747:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785219736.095752:0:7475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf37e4b1000 from 1 10000000:01000000:1.0:1785219736.095755:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785219736.095787:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.095795:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.095804:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.095832:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055104:0@lo:101: 00000100:00100000:1.0:1785219736.095891:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.095928:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465055104 00000100:00100000:1.0:1785219736.095933:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465055104 00000100:00100000:1.0:1785219736.095959:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1785219736.095966:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465055104:12345-0@lo:101: 00010000:00010000:1.0:1785219736.095976:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219736.095987:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c674 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.096008:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c674 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.096017:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c674 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.096025:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341477e00, rc 0) 00000100:00100000:1.0:1785219736.096051:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055104:12345-0@lo:101: Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.096058:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1785219736.096091:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371b10900 going to sleep for 11 seconds 00000100:00100000:1.0:1785219736.096107:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055104:0@lo:101: 00010000:00010000:1.0:1785219736.096118:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.096127:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.096340:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055232:0@lo:501: 00000100:00100000:1.0:1785219736.096392:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.096482:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465055232 00000100:00100000:1.0:1785219736.096487:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465055232 00000100:00100000:1.0:1785219736.096504:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1785219736.096510:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055232:12345-0@lo:501: 00000100:00100000:1.0:1785219736.096753:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055232:12345-0@lo:501: Request processed in 242us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.096760:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1785219736.096789:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371b10900 going to sleep for 11 seconds 00000100:00100000:1.0:1785219736.096803:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055232:0@lo:501: 00000100:00100000:1.0:1785219736.096829:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055360:0@lo:503: 00000100:00100000:1.0:1785219736.096865:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.096896:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465055360 00000100:00100000:1.0:1785219736.096899:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465055360 00000100:00100000:1.0:1785219736.096916:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785219736.096921:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055360:12345-0@lo:503: 00000100:00100000:1.0:1785219736.097045:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055360:12345-0@lo:503: Request processed in 123us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.097051:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785219736.097077:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371b10900 going to sleep for 11 seconds 00000100:00100000:1.0:1785219736.097090:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055360:0@lo:503: 00000040:00080000:1.0:1785219736.097817:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785219736.097876:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055488:0@lo:502: 00000100:00100000:1.0:1785219736.097937:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.098009:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350b98c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.098071:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465055488 00000100:00100000:2.0:1785219736.098077:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465055488 00000100:00100000:0.0:1785219736.098153:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785219736.098164:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055488:12345-0@lo:502: 00000100:00100000:1.0:1785219736.098603:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055488:12345-0@lo:502: Request processed in 440us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.098610:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785219736.098994:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055488:0@lo:502: 00000040:00080000:0.0:1785219736.099344:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1785219736.099540:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1785219736.099578:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1785219736.099626:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1785219736.099664:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1785219736.099822:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1785219736.099864:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1785219736.099929:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1785219736.099979:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1785219736.100016:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1785219736.100051:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1785219736.100112:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1785219736.100144:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1785219736.100176:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1785219736.100516:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1785219736.100561:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1785219736.100596:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1785219736.100643:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1785219736.100677:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1785219736.100889:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1785219736.100948:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1785219736.100985:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1785219736.101021:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1785219736.101086:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1785219736.101125:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1785219736.101159:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1785219736.101349:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1785219736.101676:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1785219736.101724:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1785219736.101780:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1785219736.101816:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1785219736.101851:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1785219736.101891:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1785219736.101956:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1785219736.101995:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1785219736.102042:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1785219736.102076:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1785219736.102122:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055616:0@lo:502: 00000100:00100000:1.0:1785219736.102200:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.102650:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371b10900 going to sleep for 11 seconds 00000100:00100000:3.0:1785219736.102748:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465055616 00000100:00100000:3.0:1785219736.102756:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465055616 00000100:00100000:3.0:1785219736.102795:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1785219736.102804:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055616:12345-0@lo:502: 00000100:00100000:3.0:1785219736.104156:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465055616:12345-0@lo:502: Request processed in 1346us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219736.104167:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785219736.104315:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465055616:0@lo:502: 00000040:00080000:1.0:1785219736.104606:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1785219736.104620:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1785219736.111113:0:7488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1785219736.111132:0:7488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cf371a70000) 00000020:00000080:1.0:1785219736.111155:0:7488:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1785219736.111591:0:7488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf37e4b1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1785219736.111596:0:7488:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf37e4b1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1785219736.111599:0:7488:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf37e4b1000 3 00010000:00080000:1.0:1785219736.111630:0:7488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf34874d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1785219736.120947:0:7488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1785219736.121056:0:7488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1785219736.121100:0:7488:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785219736.121125:0:7488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8b38d407a078c689 00000100:00080000:1.0:1785219736.121137:0:7488:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785219736.121142:0:7488:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cf34874d000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1785219736.121179:0:7488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf36cf0ad80 x1871938465055744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785219736.121313:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465055744:0@lo:38: 00000100:00100000:2.0:1785219736.121477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.121567:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465055744 00000100:00100000:1.0:1785219736.121575:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465055744 00000100:00100000:1.0:1785219736.121605:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785219736.121612:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1871938465055744:12345-0@lo:38: 00010000:00080000:1.0:1785219736.121636:0:5794:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1785219736.121666:0:5794:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8b38d407a078c690 00000004:00100000:1.0:1785219736.121681:0:5794:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1785219736.121713:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219736.124269:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871938465055744:12345-0@lo:38: Request processed in 2649us (2786us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.124283:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1785219736.124322:0:7488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1785219736.125854:0:7490:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9cf36cf09f80 x1871938465055872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219736.125868:0:7490:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3506efcc0 going to sleep for 0 seconds 00000040:00080000:3.0:1785219736.125984:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1785219736.126113:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1785219736.126141:0:7475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785219736.126162:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.126174:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1785219736.126329:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1785219736.126331:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785219736.126333:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219736.126334:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219736.126335:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219736.126337:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219736.126338:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785219736.126339:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785219736.126341:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785219736.126342:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219736.126343:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785219736.126347:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1785219736.126350:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785219736.126351:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785219736.126352:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219736.126353:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219736.126354:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219736.126356:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219736.126357:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785219736.126358:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785219736.126358:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785219736.126359:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219736.126360:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785219736.126512:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1785219736.126524:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465056000:0@lo:253: 00000100:00100000:1.0:1785219736.126587:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.126621:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3506ef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219736.126790:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056000 00000100:00100000:3.0:1785219736.126797:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056000 00000100:00100000:3.0:1785219736.126842:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1785219736.126852:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7475:x1871938465056000:12345-0@lo:253: 20000000:01000000:3.0:1785219736.126887:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1785219736.126906:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1785219736.127655:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf0ad80 x1871938465055744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785219746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219736.127668:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785219736.127677:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1785219736.127684:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1785219736.127689:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785219736.127692:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf34874d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1785219736.127709:0:3305:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001293dfd2): req@ffff9cf36cf09f80 x1871938465055872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219736.127729:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465055744:0@lo:38: 00000100:00100000:1.0:1785219736.127924:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.127958:0:7490:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3506efcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219736.128007:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465055872 00000100:00100000:3.0:1785219736.128013:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465055872 00000100:00100000:3.0:1785219736.128068:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219736.128076:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1871938465055872:12345-0@lo:901: 00000100:00080000:1.0:1785219736.128499:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219736.128665:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1871938465055872:12345-0@lo:901: Request processed in 588us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219736.128673:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1785219736.128736:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf36cf09f80 x1871938465055872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1785219752 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219736.128748:0:7490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1871938465055872:0@lo:901: 20000000:01000000:2.0:1785219736.153517:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1785219736.153540:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1785219736.154837:0:5809:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785219736.154860:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785219736.154918:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.154938:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.154947:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.154992:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.155006:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 14 pid: 5785 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.155020:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1871938465056128:0@lo:104: 00000100:00100000:1.0:1785219736.155084:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219736.155130:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3506ef300 going to sleep for 11 seconds 00000100:00100000:2.0:1785219736.156190:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056128 00000100:00100000:2.0:1785219736.156200:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056128 00000100:00100000:2.0:1785219736.156264:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219736.156273:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5809:x1871938465056128:12345-0@lo:104: 00010000:00010000:2.0:1785219736.156288:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.156360:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785219736.156391:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:5809:x1871938465056128:12345-0@lo:104: Request processed in 119us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219736.156397:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1785219736.156831:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219736.156838:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.156858:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81000 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219736.156862:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.156870:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219736.156877:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219736.156892:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1785219736.156931:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.156937:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219736.156956:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.156962:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f81000/0x8b38d407a078c5d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c5da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.156978:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219736.156980:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219736.156982:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219736.156995:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465056256:0@lo:103: 00000100:00100000:2.0:1785219736.157651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219736.157738:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1871938465056128:0@lo:104: 00010000:00010000:2.0:1785219736.157762:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.157849:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056256 00000100:00100000:1.0:1785219736.157857:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056256 00010000:00010000:1.0:1785219736.157892:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 15 pid: 5785 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219736.157929:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785219736.157937:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:3306:x1871938465056256:12345-0@lo:103: 00010000:00010000:1.0:1785219736.157951:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219736.157956:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 15 pid: 5785 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.157967:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 15 pid: 5785 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.157991:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f80a00/0x8b38d407a078c5da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c5d3 expref: 15 pid: 5785 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158009:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158027:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785219736.158041:0:5779:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003182609s 00010000:00010000:1.0:1785219736.158046:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158053:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158060:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158066:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158073:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219736.158077:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158084:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158096:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219736.158113:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219736.158151:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:3306:x1871938465056256:12345-0@lo:103: Request processed in 216us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219736.158158:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219736.158640:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465056256:0@lo:103: 00010000:00010000:2.0:1785219736.158664:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.158671:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219736.158677:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c697 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219736.167309:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:7475:x1871938465056000:12345-0@lo:253: Request processed in 40449us (40712us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219736.167325:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785219736.167575:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6828c272-120a-44fd-b7c4-fcf074b0473f:7475:1871938465056000:0@lo:253: 10000000:01000000:1.0:1785219736.167591:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1785219736.167595:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785219736.167596:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785219736.167598:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219736.167599:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219736.167600:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219736.167602:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219736.167603:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785219736.167605:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785219736.167606:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785219736.167608:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219736.167609:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1785219736.167628:0:7475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1785219736.174229:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1785219736.175073:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1785219736.175557:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1785219736.175719:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1785219736.175931:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1785219736.176315:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1785219736.177944:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1785219736.404221:0:7475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1785219736.404229:0:7475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1785219736.404284:0:7475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1785219736.404342:0:7475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1785219736.404357:0:7475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1785219736.404411:0:7475:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1785219736.939465:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219737.963580:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219738.987555:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219740.015570:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219741.035534:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219741.102488:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465056384:0@lo:13: 00000100:00100000:2.0:1785219741.102566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219741.102692:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056384 00000100:00100000:0.0:1785219741.102701:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056384 00000100:00100000:0.0:1785219741.102764:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785219741.102773:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465056384:12345-0@lo:13: 00002000:00000024:0.0:1785219741.102808:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219741.102863:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465056384:12345-0@lo:13: Request processed in 91us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219741.102870:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1785219741.102928:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785219741.102957:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348067800 x1871938465056384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219741.102975:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465056384:0@lo:13: 00000100:00100000:1.0:1785219741.614272:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465056640:0@lo:400: 00000100:00100000:1.0:1785219741.614339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219741.614421:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785219741.614431:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465056512:0@lo:400: 00000100:00100000:2.0:1785219741.614460:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465056768:0@lo:400: 00000100:00100000:1.0:1785219741.614478:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219741.614486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219741.614501:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465057024:0@lo:400: 00000100:00100000:2.0:1785219741.614505:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219741.614510:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465056896:0@lo:400: 00000100:00100000:2.0:1785219741.614532:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219741.614579:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056640 00000100:00100000:2.0:1785219741.614586:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056640 00000100:00100000:2.0:1785219741.614627:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056768 00000100:00100000:2.0:1785219741.614630:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056768 00000100:00100000:2.0:1785219741.614656:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785219741.614664:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465056640:12345-0@lo:400: 00000100:00100000:2.0:1785219741.614714:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465056640:12345-0@lo:400: Request processed in 50us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219741.614721:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785219741.614737:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219741.614743:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465056768:12345-0@lo:400: 00000100:00100000:2.0:1785219741.614790:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465056768:12345-0@lo:400: Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219741.614796:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219741.614813:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056896 00000100:00100000:2.0:1785219741.614817:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056896 00000100:00100000:2.0:1785219741.614851:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785219741.614858:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465056896:12345-0@lo:400: 00000100:00100000:2.0:1785219741.614889:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465056896:12345-0@lo:400: Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219741.614895:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1785219741.614913:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785219741.614942:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cf08000 x1871938465056896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219741.614958:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465056896:0@lo:400: 00010000:00080000:2.0:1785219741.614969:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cf0a680 x1871938465056768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219741.614991:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465056768:0@lo:400: 00000100:00100000:1.0:1785219741.615691:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1785219741.615725:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cf0b800 x1871938465056640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219741.615735:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465056640:0@lo:400: 00000100:00100000:1.0:1785219741.615758:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057024 00000100:00100000:1.0:1785219741.615762:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057024 00000100:00100000:1.0:1785219741.615792:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785219741.615797:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465057024:12345-0@lo:400: 00000100:00100000:1.0:1785219741.615833:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465057024:12345-0@lo:400: Request processed in 35us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219741.615838:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785219741.615867:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465056512 00000100:00100000:1.0:1785219741.615870:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465056512 00000100:00100000:1.0:1785219741.615893:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1785219741.615899:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:3309:x1871938465056512:12345-0@lo:400: 00000100:00100000:1.0:1785219741.615927:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:3309:x1871938465056512:12345-0@lo:400: Request processed in 29us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219741.615933:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1785219741.615959:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219741.615977:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465056512:0@lo:400: 00010000:00080000:1.0:1785219741.617643:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cf09180 x1871938465057024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219741.617658:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465057024:0@lo:400: 00010000:00010000:0.0:1785219742.066303:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785219742.206305:0:7831:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1785219743.092117:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785219743.659474:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785219743.659483:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf349c7c000 from 30 10000000:01000000:3.0:1785219743.659489:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785219743.659537:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.659549:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.659559:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219743.659595:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057152:0@lo:101: 00000100:00100000:3.0:1785219743.659670:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.659747:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a7f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785219743.659814:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057152 00000100:00100000:2.0:1785219743.659822:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057152 00000100:00100000:2.0:1785219743.659880:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1785219743.659890:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465057152:12345-0@lo:101: 00010000:00010000:2.0:1785219743.659902:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219743.659915:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c69e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.659937:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c69e expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.659948:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c69e expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.659957:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81000, rc 0) 00000100:00100000:2.0:1785219743.660006:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465057152:12345-0@lo:101: Request processed in 117us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219743.660012:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1785219743.660106:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057152:0@lo:101: 00010000:00010000:3.0:1785219743.660120:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.660129:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219743.660179:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057280:0@lo:501: 00000100:00100000:3.0:1785219743.660207:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.660225:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a7f6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.660315:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057280 00000100:00100000:0.0:1785219743.660319:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057280 00000100:00100000:0.0:1785219743.660340:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1785219743.660346:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465057280:12345-0@lo:501: 00000100:00100000:0.0:1785219743.660682:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465057280:12345-0@lo:501: Request processed in 336us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.660692:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785219743.660776:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057280:0@lo:501: 00000100:00100000:3.0:1785219743.660796:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057408:0@lo:503: 00000100:00100000:3.0:1785219743.660823:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.660854:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a7f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1785219743.660883:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057408 00000100:00100000:1.0:1785219743.660888:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057408 00000100:00100000:1.0:1785219743.660919:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1785219743.660926:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465057408:12345-0@lo:503: 00000100:00100000:1.0:1785219743.661240:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465057408:12345-0@lo:503: Request processed in 313us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219743.661246:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1785219743.661502:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057408:0@lo:503: 00000100:00100000:1.0:1785219743.662002:0:7914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7914:1871938465057536:0@lo:502: 00000100:00100000:1.0:1785219743.662052:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219743.662126:0:7914:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342dccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219743.662197:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057536 00000100:00100000:2.0:1785219743.662204:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057536 00000100:00100000:2.0:1785219743.662240:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1785219743.662248:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7914:x1871938465057536:12345-0@lo:502: 00000100:00100000:2.0:1785219743.662535:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7914:x1871938465057536:12345-0@lo:502: Request processed in 288us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219743.662551:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785219743.662645:0:7914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7914:1871938465057536:0@lo:502: 00000100:00100000:1.0:1785219743.662686:0:7914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7914:1871938465057664:0@lo:502: 00000100:00100000:1.0:1785219743.662716:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219743.662745:0:7914:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342dccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219743.662789:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057664 00000100:00100000:2.0:1785219743.662794:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057664 00000100:00100000:2.0:1785219743.662818:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785219743.662825:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7914:x1871938465057664:12345-0@lo:502: 00000100:00100000:2.0:1785219743.663001:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:7914:x1871938465057664:12345-0@lo:502: Request processed in 176us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219743.663007:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1785219743.668645:0:7914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7914:1871938465057664:0@lo:502: 00000040:00080000:1.0:1785219743.668699:0:7914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1785219743.668904:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1785219743.668973:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785219743.668985:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.668996:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219743.669006:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1785219743.669009:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1785219743.669012:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1785219743.669046:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.669065:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.669075:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219743.669096:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057792:0@lo:101: 00000100:00100000:3.0:1785219743.669162:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.669208:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350caaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219743.669854:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057792 00000100:00100000:2.0:1785219743.669865:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057792 00000100:00100000:2.0:1785219743.669919:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785219743.669928:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465057792:12345-0@lo:101: 00010000:00010000:2.0:1785219743.669943:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219743.669960:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c6ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.669985:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.669994:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.670003:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81a00, rc 0) 00000100:00100000:2.0:1785219743.670050:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465057792:12345-0@lo:101: Request processed in 123us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219743.670057:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785219743.670101:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057792:0@lo:101: 00010000:00010000:2.0:1785219743.670128:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.670138:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219743.670196:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057920:0@lo:501: 00000100:00100000:2.0:1785219743.670222:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219743.670255:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.671729:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465057920 00000100:00100000:3.0:1785219743.671743:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465057920 00000100:00100000:3.0:1785219743.671795:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785219743.671804:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465057920:12345-0@lo:501: 00000100:00100000:3.0:1785219743.672092:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465057920:12345-0@lo:501: Request processed in 288us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.672099:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785219743.672149:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465057920:0@lo:501: 00000100:00100000:3.0:1785219743.672191:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058048:0@lo:503: 00000100:00100000:3.0:1785219743.672231:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.672258:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350caaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.672270:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058048 00000100:00100000:3.0:1785219743.672273:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058048 00000100:00100000:3.0:1785219743.672289:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1785219743.672295:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465058048:12345-0@lo:503: 00000100:00100000:3.0:1785219743.672607:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465058048:12345-0@lo:503: Request processed in 311us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.672623:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1785219743.672664:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058048:0@lo:503: 00000100:00100000:3.0:1785219743.672822:0:7916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7916:1871938465058176:0@lo:502: 00000100:00100000:3.0:1785219743.672865:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.672884:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058176 00000100:00100000:3.0:1785219743.672888:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058176 00000100:00100000:3.0:1785219743.672904:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1785219743.672910:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:7916:x1871938465058176:12345-0@lo:502: 00000100:00100000:3.0:1785219743.673051:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:7916:x1871938465058176:12345-0@lo:502: Request processed in 140us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.673057:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1785219743.673082:0:7916:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a06f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.673095:0:7916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7916:1871938465058176:0@lo:502: 00000020:01000000:3.0:1785219743.673114:0:7916:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219743.673123:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219743.673125:0:7916:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785219743.673130:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785219743.673132:0:7916:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1785219743.673146:0:7916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7916:1871938465058304:0@lo:502: 00000100:00100000:3.0:1785219743.673176:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.673310:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058304 00000100:00100000:0.0:1785219743.673314:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058304 00000100:00100000:0.0:1785219743.673333:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1785219743.673339:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:7916:x1871938465058304:12345-0@lo:502: 00000100:00100000:0.0:1785219743.678895:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:7916:x1871938465058304:12345-0@lo:502: Request processed in 5546us (5708us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.678910:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1785219743.683508:0:7916:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.683552:0:7916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7916:1871938465058304:0@lo:502: 00000020:01000000:3.0:1785219743.685278:0:7916:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219743.685289:0:7916:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219743.685292:0:7916:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1785219743.685297:0:7916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1785219743.685425:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1785219743.685454:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1785219743.685466:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.685478:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219743.685488:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785219743.685492:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf3503a5000 from 30 10000000:01000000:0.0:1785219743.685495:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785219743.685534:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.685543:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.685553:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219743.685640:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058432:0@lo:101: 00000100:00100000:0.0:1785219743.685717:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.685800:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf349535600 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.685848:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058432 00000100:00100000:3.0:1785219743.685855:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058432 00000100:00100000:3.0:1785219743.685941:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1785219743.685951:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465058432:12345-0@lo:101: 00010000:00010000:3.0:1785219743.685963:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219743.685976:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c6ba expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.685998:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.686009:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.686018:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07c00, rc 0) 00000100:00100000:3.0:1785219743.686068:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465058432:12345-0@lo:101: Request processed in 119us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.686075:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1785219743.686150:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058432:0@lo:101: 00010000:00010000:2.0:1785219743.686166:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.686177:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219743.686226:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058560:0@lo:501: 00000100:00100000:2.0:1785219743.686257:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219743.686281:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.686320:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058560 00000100:00100000:0.0:1785219743.686324:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058560 00000100:00100000:0.0:1785219743.686394:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785219743.686402:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465058560:12345-0@lo:501: 00000100:00100000:0.0:1785219743.687789:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465058560:12345-0@lo:501: Request processed in 1383us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.687801:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1785219743.690128:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058560:0@lo:501: 00000100:00100000:2.0:1785219743.690199:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058688:0@lo:503: 00000100:00100000:2.0:1785219743.690283:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219743.690329:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.690465:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058688 00000100:00100000:0.0:1785219743.690472:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058688 00000100:00100000:0.0:1785219743.690524:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1785219743.690535:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465058688:12345-0@lo:503: 00000100:00100000:0.0:1785219743.690763:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465058688:12345-0@lo:503: Request processed in 230us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.690772:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1785219743.690791:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465058688:0@lo:503: 00000100:00100000:2.0:1785219743.692435:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7918:1871938465058816:0@lo:502: 00000100:00100000:2.0:1785219743.692502:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219743.692549:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5600 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.693184:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058816 00000100:00100000:0.0:1785219743.693194:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058816 00000100:00100000:0.0:1785219743.693251:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785219743.693260:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:7918:x1871938465058816:12345-0@lo:502: 00000100:00100000:0.0:1785219743.693544:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:7918:x1871938465058816:12345-0@lo:502: Request processed in 284us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.693554:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1785219743.693573:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7918:1871938465058816:0@lo:502: 00000100:00100000:3.0:1785219743.693637:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7918:1871938465058944:0@lo:502: 00000100:00100000:3.0:1785219743.693674:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.693705:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348731c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.693812:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465058944 00000100:00100000:0.0:1785219743.693817:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465058944 00000100:00100000:0.0:1785219743.693857:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785219743.693865:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:7918:x1871938465058944:12345-0@lo:502: 00000100:00100000:0.0:1785219743.694139:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:7918:x1871938465058944:12345-0@lo:502: Request processed in 275us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.694147:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785219743.694163:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7918:1871938465058944:0@lo:502: 00000040:00080000:3.0:1785219743.694185:0:7918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1785219743.694287:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1785219743.694309:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785219743.694320:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.694331:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219743.694340:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785219743.694342:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf3503a5000 from 5 10000000:01000000:0.0:1785219743.694345:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785219743.694393:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.694401:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.694410:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219743.694424:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059072:0@lo:101: 00000100:00100000:0.0:1785219743.694454:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.694488:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785219743.694495:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059072 00000100:00100000:1.0:1785219743.694502:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059072 00000100:00100000:1.0:1785219743.694534:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1785219743.694542:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465059072:12345-0@lo:101: 00010000:00010000:1.0:1785219743.694550:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219743.694562:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341476200/0x8b38d407a078c6cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c6c8 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.694583:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341476200/0x8b38d407a078c6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c6c8 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.694601:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341476200/0x8b38d407a078c6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c6c8 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.694610:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476200, rc 0) 00000100:00100000:1.0:1785219743.694653:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465059072:12345-0@lo:101: Request processed in 112us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219743.694659:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1785219743.694732:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059072:0@lo:101: 00010000:00010000:0.0:1785219743.694746:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.694767:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219743.694809:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059200:0@lo:256: 00000100:00100000:0.0:1785219743.694851:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.694871:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785219743.694906:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059200 00000100:00100000:1.0:1785219743.694909:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059200 00000100:00100000:1.0:1785219743.694933:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1785219743.694940:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465059200:12345-0@lo:256: 20000000:01000000:1.0:1785219743.694953:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1785219743.694970:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1785219743.694973:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1785219743.695043:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465059200:12345-0@lo:256: Request processed in 102us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219743.695050:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785219743.695112:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059200:0@lo:256: 10000000:01000000:0.0:1785219743.695153:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785219743.695160:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.695168:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219743.695175:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1785219743.695177:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1785219743.695180:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1785219743.695198:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.695205:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.695213:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219743.695224:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059328:0@lo:101: 00000100:00100000:0.0:1785219743.695258:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.695307:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785219743.696790:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059328 00000100:00100000:1.0:1785219743.696802:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059328 00000100:00100000:0.0:1785219743.698211:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785219743.698223:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465059328:12345-0@lo:101: 00010000:00010000:0.0:1785219743.698240:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219743.698258:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c6d6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.698288:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.698299:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219743.698307:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:0.0:1785219743.698403:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465059328:12345-0@lo:101: Request processed in 182us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.698409:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1785219743.698612:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059328:0@lo:101: 00010000:00010000:2.0:1785219743.698632:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219743.698643:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219743.698711:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059456:0@lo:501: 00000100:00100000:2.0:1785219743.698743:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219743.698805:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1785219743.705574:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059456 00000100:00100000:1.0:1785219743.705589:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059456 00000100:00100000:1.0:1785219743.705686:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1785219743.705696:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465059456:12345-0@lo:501: 00000100:00100000:1.0:1785219743.705997:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465059456:12345-0@lo:501: Request processed in 302us (7252us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219743.706005:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1785219743.712064:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059456:0@lo:501: 00000100:00100000:1.0:1785219743.712136:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059584:0@lo:503: 00000100:00100000:1.0:1785219743.712217:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219743.712263:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342dccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219743.712465:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059584 00000100:00100000:2.0:1785219743.712472:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059584 00000100:00100000:2.0:1785219743.712518:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1785219743.712527:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465059584:12345-0@lo:503: 00000100:00100000:2.0:1785219743.712881:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465059584:12345-0@lo:503: Request processed in 354us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219743.712889:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1785219743.713127:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465059584:0@lo:503: 00000100:00100000:1.0:1785219743.717606:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7922:1871938465059712:0@lo:502: 00000100:00100000:1.0:1785219743.717691:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219743.717736:0:7922:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342dcc000 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.717909:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059712 00000100:00100000:3.0:1785219743.717917:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059712 00000100:00100000:3.0:1785219743.717971:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1785219743.717980:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:7922:x1871938465059712:12345-0@lo:502: 00000100:00100000:3.0:1785219743.718293:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:7922:x1871938465059712:12345-0@lo:502: Request processed in 314us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.718301:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1785219743.718498:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7922:1871938465059712:0@lo:502: 00000020:01000000:1.0:1785219743.718527:0:7922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1785219743.718534:0:7922:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1785219743.718540:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219743.718543:0:7922:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1785219743.718548:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1785219743.718551:0:7922:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:1.0:1785219743.718573:0:7922:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1785219743.718576:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785219743.718588:0:7922:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cf371a74d40) 00000020:00000080:1.0:1785219743.718608:0:7922:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1785219743.718613:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1785219743.718700:0:7922:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1785219743.718706:0:7922:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1785219743.718713:0:7922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078c6eb 00010000:00080000:1.0:1785219743.718739:0:7922:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf348632800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1785219743.718975:0:7922:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1785219743.719281:0:7922:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1785219743.719293:0:7922:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1785219743.719824:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219743.720041:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219743.720086:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1785219743.720139:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1785219743.725303:0:7923:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785219743.725313:0:7923:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1785219743.726395:0:7922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1785219743.726409:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1785219743.726446:0:7922:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1785219743.726468:0:7922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078c6f2 00000100:00080000:2.0:1785219743.726479:0:7922:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785219743.726485:0:7922:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf348632800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1785219743.726524:0:7922:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf36dc02d80 x1871938465059840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785219743.726544:0:7922:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1785219743.726678:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465059840:0@lo:8: 00000100:00100000:0.0:1785219743.726749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.726809:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059840 00000100:00100000:0.0:1785219743.726817:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059840 00000100:00100000:0.0:1785219743.726858:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785219743.726865:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1871938465059840:12345-0@lo:8: 00010000:00080000:0.0:1785219743.726888:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:0.0:1785219743.726910:0:6589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078c6f9 00002000:00100000:0.0:1785219743.726921:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cf2461ec000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cc ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1785219743.726936:0:6589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1785219743.726940:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1785219743.727058:0:6589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1785219743.727194:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785219743.727216:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9cf2461ed800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219743.727268:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1871938465059840:12345-0@lo:8: Request processed in 401us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.727275:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1785219743.727311:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc02d80 x1871938465059840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785219753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219743.727321:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785219743.727328:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1785219743.727334:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1785219743.727338:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1785219743.727341:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf348632800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1785219743.727348:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1785219743.727353:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465059840:0@lo:8: 00000020:01000000:2.0:1785219743.727566:0:7922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219743.727643:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219743.727646:0:7922:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1785219743.727651:0:7922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785219743.727656:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219743.727657:0:7922:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1785219743.727659:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1785219743.727661:0:7922:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1785219743.727689:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7922:1871938465059968:0@lo:502: 00000100:00100000:2.0:1785219743.727737:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219743.727763:0:7922:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.728322:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465059968 00000100:00100000:0.0:1785219743.728329:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465059968 00000100:00100000:0.0:1785219743.728388:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1785219743.728396:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:7922:x1871938465059968:12345-0@lo:502: 00000100:00100000:0.0:1785219743.728610:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:7922:x1871938465059968:12345-0@lo:502: Request processed in 214us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219743.728617:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:1.0:1785219743.729500:0:7923:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1785219743.729712:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465060096:0@lo:400: 00000100:00100000:3.0:1785219743.729758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.729789:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785219743.729795:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465060480:0@lo:400: 00000100:00100000:3.0:1785219743.729818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.729862:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465060224:0@lo:400: 00000100:00100000:3.0:1785219743.729883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1785219743.729899:0:7923:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 236582534128ns, next at 0ns, rc = 0 00000100:00100000:3.0:1785219743.729901:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785219743.729906:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465060352:0@lo:400: 00000100:00100000:3.0:1785219743.729928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.729956:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060096 00000100:00100000:1.0:1785219743.729956:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060352 00000100:00100000:3.0:1785219743.729961:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060096 00000100:00100000:1.0:1785219743.729961:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060352 00000100:00100000:3.0:1785219743.729992:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060480 00000100:00100000:3.0:1785219743.729994:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060480 00000100:00100000:1.0:1785219743.729996:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785219743.730003:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465060352:12345-0@lo:400: 00000100:00100000:3.0:1785219743.730006:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060224 00000100:00100000:3.0:1785219743.730007:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060224 00000100:00100000:3.0:1785219743.730019:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785219743.730023:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465060096:12345-0@lo:400: 00000100:00100000:1.0:1785219743.730047:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465060352:12345-0@lo:400: Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219743.730053:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785219743.730054:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465060096:12345-0@lo:400: Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.730059:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785219743.730069:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1785219743.730070:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785219743.730074:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219743.730075:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465060480:12345-0@lo:400: 00000100:00100000:3.0:1785219743.730099:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465060480:12345-0@lo:400: Request processed in 24us (279us total) trans 0 rc 0/0 00010000:00080000:1.0:1785219743.730099:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37e467b80 x1871938465060352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219743.730110:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785219743.730112:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465060352:0@lo:400: 00000100:00100000:3.0:1785219743.730120:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785219743.730125:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465060224:12345-0@lo:400: 00000100:00100000:3.0:1785219743.730164:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465060224:12345-0@lo:400: Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.730169:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1785219743.730199:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37e464000 x1871938465060480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219743.730208:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465060480:0@lo:400: 00010000:00080000:3.0:1785219743.730217:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37e465500 x1871938465060096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219743.730224:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465060096:0@lo:400: 00010000:00080000:1.0:1785219743.730661:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37e464a80 x1871938465060224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219743.730671:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465060224:0@lo:400: 00000100:00100000:2.0:1785219743.731722:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:7922:1871938465059968:0@lo:502: 00000020:01000000:2.0:1785219743.731779:0:7922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219743.731785:0:7922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219743.731787:0:7922:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1785219743.731792:0:7922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1785219743.732549:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1785219743.732572:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785219743.732582:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.732594:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219743.732610:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1785219743.732613:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf3486699c0 from 1 10000000:01000000:1.0:1785219743.732615:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785219743.732850:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.732859:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.732869:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219743.732890:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465060608:0@lo:101: 00000100:00100000:1.0:1785219743.732944:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219743.733017:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342dcccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.733051:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060608 00000100:00100000:3.0:1785219743.733057:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060608 00000100:00100000:3.0:1785219743.733096:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1785219743.733104:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465060608:12345-0@lo:101: 00010000:00010000:3.0:1785219743.733115:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219743.733126:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c700 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.733147:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c700 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.733156:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c700 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219743.733174:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07a00, rc 0) 00000100:00100000:3.0:1785219743.733210:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465060608:12345-0@lo:101: Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.733216:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1785219743.733279:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465060608:0@lo:101: 00010000:00010000:1.0:1785219743.733292:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.733300:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219743.733344:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465060736:0@lo:501: 00000100:00100000:1.0:1785219743.733385:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219743.733401:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342dcccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.733447:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060736 00000100:00100000:0.0:1785219743.733452:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060736 00000100:00100000:0.0:1785219743.733478:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1785219743.733495:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465060736:12345-0@lo:501: 00000100:00100000:0.0:1785219743.733676:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465060736:12345-0@lo:501: Request processed in 181us (290us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785219743.733683:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1785219743.733841:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465060736:0@lo:501: 10000000:01000000:1.0:1785219743.733862:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785219743.733872:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219743.733881:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785219743.788506:0:7924:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1785219743.788528:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465060864:0@lo:13: 00000100:00100000:0.0:1785219743.788530:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465060992:0@lo:7: 00000100:00100000:3.0:1785219743.791503:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.792271:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.792303:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1785219743.792501:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060864 00000100:00100000:1.0:1785219743.792510:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060864 00000100:00100000:1.0:1785219743.792569:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785219743.792580:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1871938465060864:12345-0@lo:13: 00002000:00000024:1.0:1785219743.792618:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1785219743.793006:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1871938465060864:12345-0@lo:13: Request processed in 427us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219743.793014:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785219743.793309:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465060992 00000100:00100000:3.0:1785219743.793315:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465060992 00000100:00100000:3.0:1785219743.793345:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785219743.793351:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7924:x1871938465060992:12345-0@lo:7: 00010000:00080000:3.0:1785219743.795996:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348064e00 x1871938465060864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219743.796025:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465060864:0@lo:13: 00000100:00080000:0.0:1785219743.796149:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1785219743.800662:0:6588:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1785219743.800670:0:6588:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1785219743.800768:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7924:x1871938465060992:12345-0@lo:7: Request processed in 7413us (8495us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219743.800778:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1785219743.801516:0:7924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348066300 x1871938465060992/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785219759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219743.801533:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465060992:0@lo:7: 00000004:00080000:3.0:1785219743.801547:0:7924:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1785219743.801582:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465061120:0@lo:5: 00000100:00100000:3.0:1785219743.801616:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.801650:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35061d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.801669:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465061120 00000100:00100000:3.0:1785219743.801675:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465061120 00000100:00100000:3.0:1785219743.801714:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785219743.801722:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7924:x1871938465061120:12345-0@lo:5: 00002000:00080000:3.0:1785219743.801746:0:6589:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1785219743.801749:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1785219743.802031:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7924:x1871938465061120:12345-0@lo:5: Request processed in 309us (413us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1785219743.802037:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1785219743.802063:0:7924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37e464000 x1871938465061120/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785219759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219743.802074:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465061120:0@lo:5: 00000004:00080000:3.0:1785219743.802083:0:7924:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1785219743.802105:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e467b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465061248:0@lo:700: 00000100:00100000:3.0:1785219743.802126:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.802141:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35061d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.802165:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465061248 00000100:00100000:3.0:1785219743.802168:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465061248 00000100:00100000:3.0:1785219743.802194:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785219743.802199:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7924:x1871938465061248:12345-0@lo:700: 00000100:00100000:3.0:1785219743.802224:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e466a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6595:1871938465061376:0@lo:700: 00000100:00100000:3.0:1785219743.802249:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219743.802266:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35061db40 going to sleep for 11 seconds 00000100:00100000:0.0:1785219743.807913:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465061376 00000100:00100000:0.0:1785219743.807926:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465061376 00000100:00100000:0.0:1785219743.807975:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785219743.807983:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6595:x1871938465061376:12345-0@lo:700: 00000004:00080000:0.0:1785219743.825437:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1785219743.864597:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1785219743.878463:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6595:x1871938465061376:12345-0@lo:700: Request processed in 70476us (76207us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219743.878483:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785219743.878601:0:6595:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37e466a00 x1871938465061376/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785219759 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219743.878616:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e466a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6595:1871938465061376:0@lo:700: 40000000:02000000:3.0:1785219743.878643:0:6595:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1785219743.929944:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1785219743.929974:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1785219743.930255:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7924:x1871938465061248:12345-0@lo:700: Request processed in 128050us (128123us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219743.930268:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1785219743.930387:0:7924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37e467b80 x1871938465061248/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785219759 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219743.930400:0:7924:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1785219743.930417:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e467b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465061248:0@lo:700: 00000004:02000040:0.0:1785219743.947392:0:7924:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1785219743.950862:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465061504:0@lo:5: 00000100:00100000:0.0:1785219743.950932:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219743.951058:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219743.951131:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465061504 00000100:00100000:3.0:1785219743.951139:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465061504 00000100:00100000:3.0:1785219743.951191:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785219743.951201:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7924:x1871938465061504:12345-0@lo:5: 00002000:00080000:3.0:1785219743.955568:0:6588:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1785219743.955592:0:6588:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1785219743.958528:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7924:x1871938465061504:12345-0@lo:5: Request processed in 7323us (7590us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1785219743.958542:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1785219743.958776:0:7924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348067800 x1871938465061504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785219759 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219743.958796:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7924:1871938465061504:0@lo:5: 00000004:00080000:0.0:1785219743.958822:0:7924:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1785219744.108336:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219745.133405:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219746.155711:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219746.219866:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465061632:0@lo:13: 00000100:00100000:1.0:1785219746.220067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219746.220392:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465061632 00000100:00100000:0.0:1785219746.220403:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465061632 00000100:00100000:0.0:1785219746.220489:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1785219746.220498:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219746.220504:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465061632:12345-0@lo:13: 00002000:00000024:0.0:1785219746.220549:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219746.220620:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465061632:12345-0@lo:13: Request processed in 120us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219746.220629:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1785219746.220678:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348065c00 x1871938465061632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219746.220702:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465061632:0@lo:13: 00000001:00080000:1.0:1785219746.764925:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1785219747.180623:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219747.229648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.229795:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444066944 00000100:00100000:3.0:1785219747.229817:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444066944 00000100:00100000:3.0:1785219747.229921:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1785219747.229931:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1871938444066944:12345-192.168.203.31@tcp:250: 00010000:00080000:3.0:1785219747.229967:0:5788:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 1078a347-e541-4ca3-9e62-f1dcd49a05cf@192.168.203.31@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1785219747.230001:0:5788:0:(genops.c:1406:class_connect()) connect: client 1078a347-e541-4ca3-9e62-f1dcd49a05cf, cookie 0x8b38d407a078c70e 00000100:00080000:2.0:1785219747.231753:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9cf244b33800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785219747.231894:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+5:2358:x1871938444066944:12345-192.168.203.31@tcp:250: Request processed in 1956us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219747.231908:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1785219747.238520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.238565:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067072 00000100:00100000:3.0:1785219747.238578:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067072 00000100:00100000:3.0:1785219747.238644:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1785219747.238657:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+5:5562:x1871938444067072:12345-192.168.203.31@tcp:101: 00010000:00010000:3.0:1785219747.238755:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219747.238781:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f1e1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219747.238850:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219747.238866:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 6 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219747.238879:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07600, rc 0) 00000100:00100000:3.0:1785219747.243468:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+6:5562:x1871938444067072:12345-192.168.203.31@tcp:101: Request processed in 4796us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219747.243485:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1785219747.255290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.255463:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067200 00000100:00100000:3.0:1785219747.255473:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067200 00000100:00100000:3.0:1785219747.255521:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1785219747.255531:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+6:5562:x1871938444067200:12345-192.168.203.31@tcp:501: 00000100:00100000:3.0:1785219747.255937:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+6:5562:x1871938444067200:12345-192.168.203.31@tcp:501: Request processed in 406us (655us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785219747.255946:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:1.0:1785219747.259527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219747.259699:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067328 00000100:00100000:0.0:1785219747.259712:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067328 00000100:00100000:0.0:1785219747.259767:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1785219747.259777:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+6:5562:x1871938444067328:12345-192.168.203.31@tcp:101: 00010000:00010000:0.0:1785219747.259794:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219747.259822:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f1e8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219747.259852:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219747.259866:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219747.259890:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cc600, rc 0) 00000100:00100000:0.0:1785219747.259949:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+7:5562:x1871938444067328:12345-192.168.203.31@tcp:101: Request processed in 174us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219747.259956:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:1.0:1785219747.266948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.267051:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067456 00000100:00100000:3.0:1785219747.267065:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067456 00000100:00100000:3.0:1785219747.267146:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1785219747.267158:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+7:5562:x1871938444067456:12345-192.168.203.31@tcp:501: 00000100:00100000:2.0:1785219747.267824:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5562:x1871938444067456:12345-192.168.203.31@tcp:501: Request processed in 660us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219747.267838:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1785219747.275225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.275414:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067584 00000100:00100000:3.0:1785219747.275432:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067584 00000100:00100000:3.0:1785219747.275508:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:3.0:1785219747.275521:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5562:x1871938444067584:12345-192.168.203.31@tcp:503: 00000100:00100000:3.0:1785219747.276020:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5562:x1871938444067584:12345-192.168.203.31@tcp:503: Request processed in 500us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219747.276029:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1785219747.295624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219747.295722:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067712 00000100:00100000:2.0:1785219747.295736:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067712 00000100:00100000:2.0:1785219747.295818:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1785219747.295831:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5581:x1871938444067712:12345-192.168.203.31@tcp:502: 00000100:00100000:3.0:1785219747.299585:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5581:x1871938444067712:12345-192.168.203.31@tcp:502: Request processed in 3740us (3958us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219747.299607:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1785219747.333445:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.333595:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067840 00000100:00100000:3.0:1785219747.333610:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067840 00000100:00100000:3.0:1785219747.333683:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:3.0:1785219747.333714:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5581:x1871938444067840:12345-192.168.203.31@tcp:502: 00000100:00100000:3.0:1785219747.334104:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5581:x1871938444067840:12345-192.168.203.31@tcp:502: Request processed in 401us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219747.334114:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1785219747.343044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219747.343478:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444067968 00000100:00100000:1.0:1785219747.343505:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444067968 00000100:00100000:1.0:1785219747.343585:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:1.0:1785219747.343602:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5562:x1871938444067968:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1785219747.343625:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219747.343653:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341477800/0x8b38d407a078c723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f212 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219747.343696:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341477800/0x8b38d407a078c723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f212 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219747.343712:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341477800/0x8b38d407a078c723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f212 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219747.343726:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341477800, rc 0) 00000100:00100000:1.0:1785219747.343821:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5562:x1871938444067968:12345-192.168.203.31@tcp:101: Request processed in 226us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219747.343829:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:3.0:1785219747.348792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219747.349461:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068096 00000100:00100000:0.0:1785219747.349475:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068096 00000100:00100000:0.0:1785219747.349529:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:0.0:1785219747.349539:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5562:x1871938444068096:12345-192.168.203.31@tcp:256: 20000000:01000000:0.0:1785219747.349568:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1785219747.349594:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1785219747.349599:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1785219747.349603:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1785219747.349606:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1785219747.352323:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5562:x1871938444068096:12345-192.168.203.31@tcp:256: Request processed in 2775us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219747.352337:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:1.0:1785219747.364691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.365252:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068224 00000100:00100000:3.0:1785219747.365263:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068224 00000100:00100000:3.0:1785219747.365427:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1785219747.365437:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5562:x1871938444068224:12345-192.168.203.31@tcp:101: 00010000:00010000:3.0:1785219747.365455:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219747.365475:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f219 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219747.365505:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219747.365516:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219747.365544:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07200, rc 0) 00000100:00100000:3.0:1785219747.365611:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5562:x1871938444068224:12345-192.168.203.31@tcp:101: Request processed in 174us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219747.365618:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1785219747.376516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219747.378608:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068352 00000100:00100000:1.0:1785219747.378628:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068352 00000100:00100000:1.0:1785219747.378694:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:1.0:1785219747.378706:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5562:x1871938444068352:12345-192.168.203.31@tcp:501: 00000100:00100000:1.0:1785219747.379062:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5562:x1871938444068352:12345-192.168.203.31@tcp:501: Request processed in 356us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219747.384306:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:2.0:1785219747.392480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219747.392908:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068480 00000100:00100000:1.0:1785219747.392922:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068480 00000100:00100000:1.0:1785219747.393003:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1785219747.393033:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5562:x1871938444068480:12345-192.168.203.31@tcp:503: 00000100:00100000:1.0:1785219747.393712:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5562:x1871938444068480:12345-192.168.203.31@tcp:503: Request processed in 677us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219747.393723:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1785219747.411316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219747.412748:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068608 00000100:00100000:1.0:1785219747.412769:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068608 00000100:00100000:1.0:1785219747.412852:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1785219747.412864:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5586:x1871938444068608:12345-192.168.203.31@tcp:502: 00000100:00100000:1.0:1785219747.414615:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5586:x1871938444068608:12345-192.168.203.31@tcp:502: Request processed in 1738us (3299us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219747.414632:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1785219747.434559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219747.434656:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068736 00000100:00100000:0.0:1785219747.434670:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068736 00000100:00100000:0.0:1785219747.434776:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1785219747.434789:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5586:x1871938444068736:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1785219747.435115:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5586:x1871938444068736:12345-192.168.203.31@tcp:502: Request processed in 328us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219747.435124:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:3.0:1785219747.439770:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219747.439826:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068864 00000100:00100000:3.0:1785219747.439838:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068864 00000100:00100000:3.0:1785219747.439890:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1785219747.439902:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1871938444068864:12345-192.168.203.31@tcp:38: 00010000:00080000:3.0:1785219747.439947:0:5793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1785219747.440009:0:5793:0:(genops.c:1406:class_connect()) connect: client 3c48a627-3c4f-49d5-b2ec-dae54c1457bb, cookie 0x8b38d407a078c731 00000004:00100000:3.0:1785219747.440046:0:5793:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1785219747.440054:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1785219747.484675:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9cf348632000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219747.484786:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2358:x1871938444068864:12345-192.168.203.31@tcp:38: Request processed in 44883us (45028us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219747.484811:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00010000:00010000:3.0:1785219748.207592:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219748.491563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219748.491803:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444068992 00000100:00100000:0.0:1785219748.491835:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444068992 00000100:00100000:0.0:1785219748.491935:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1785219748.491948:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:0:x1871938444068992:12345-192.168.203.31@tcp:41: 00000004:00000024:0.0:1785219748.492013:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785219748.492100:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:0:x1871938444068992:12345-192.168.203.31@tcp:41: Request processed in 154us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219748.492107:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00080000:0.0:1785219748.492159:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219748.492496:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219748.493321:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444069120 00000100:00100000:2.0:1785219748.493334:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444069120 00000100:00100000:2.0:1785219748.493418:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1785219748.493429:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5562:x1871938444069120:12345-192.168.203.31@tcp:41: 00000004:00000024:2.0:1785219748.493459:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785219748.493519:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5562:x1871938444069120:12345-192.168.203.31@tcp:41: Request processed in 92us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219748.493526:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1785219748.503619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219748.503743:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444069248 00000100:00100000:0.0:1785219748.503757:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444069248 00000100:00100000:0.0:1785219748.503841:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1785219748.503853:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5562:x1871938444069248:12345-192.168.203.31@tcp:40: 00000100:00100000:0.0:1785219748.503977:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5562:x1871938444069248:12345-192.168.203.31@tcp:40: Request processed in 126us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219748.503985:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1785219748.507982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219748.508097:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444069376 00000100:00100000:0.0:1785219748.508110:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444069376 00000100:00100000:0.0:1785219748.508330:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1785219748.508340:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1871938444069376:12345-192.168.203.31@tcp:8: 00010000:00080000:0.0:1785219748.508432:0:6586:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:0.0:1785219748.508472:0:6586:0:(genops.c:1406:class_connect()) connect: client 3c48a627-3c4f-49d5-b2ec-dae54c1457bb, cookie 0x8b38d407a078c738 00002000:00100000:0.0:1785219748.508488:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c48a627-3c4f-49d5-b2ec-dae54c1457bb/ffff9cf2461eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785219748.508519:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785219748.508954:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785219748.508998:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9cf2461e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219748.509102:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2358:x1871938444069376:12345-192.168.203.31@tcp:8: Request processed in 760us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219748.509143:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1785219748.516354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219748.516452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219748.516581:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444069760 00000100:00100000:3.0:1785219748.516592:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444069760 00000100:00100000:3.0:1785219748.516662:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1785219748.516674:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2362:x1871938444069760:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1785219748.516749:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2362:x1871938444069760:12345-192.168.203.31@tcp:400: Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219748.516757:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:1.0:1785219748.516930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219748.517205:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444069504 00000100:00100000:2.0:1785219748.517209:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444069504 00000100:00100000:2.0:1785219748.517274:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1785219748.517279:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1871938444069504:12345-192.168.203.31@tcp:8: 00010000:00080000:2.0:1785219748.517307:0:6588:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1785219748.517337:0:6588:0:(genops.c:1406:class_connect()) connect: client 3c48a627-3c4f-49d5-b2ec-dae54c1457bb, cookie 0x8b38d407a078c73f 00002000:00100000:2.0:1785219748.517349:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c48a627-3c4f-49d5-b2ec-dae54c1457bb/ffff9cf34874e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785219748.517418:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1785219748.517445:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444069632 00000100:00100000:0.0:1785219748.517463:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444069632 00000100:00100000:0.0:1785219748.517524:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1785219748.517537:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5562:x1871938444069632:12345-192.168.203.31@tcp:33: 00002000:00080000:2.0:1785219748.517844:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785219748.517879:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9cf348749800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785219748.517926:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2358:x1871938444069504:12345-192.168.203.31@tcp:8: Request processed in 644us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219748.517946:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000004:00080000:3.0:1785219748.545092:0:5796:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27462us 00000004:00200000:0.0:1785219748.577619:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1785219748.577943:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5562:x1871938444069632:12345-192.168.203.31@tcp:33: Request processed in 60401us (61481us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219748.578078:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1785219748.740301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219748.740522:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444069888 00000100:00100000:1.0:1785219748.740535:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444069888 00000100:00100000:1.0:1785219748.740616:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1785219748.740628:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5604:x1871938444069888:12345-192.168.203.31@tcp:101: 00010000:00010000:1.0:1785219748.740657:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219748.740692:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476c00/0x8b38d407a078c746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f243 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219748.740807:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c74d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219748.740824:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c74d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219748.740840:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c74d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219748.741095:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1785219748.741101:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219748.741782:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c74d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219748.741836:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476c00/0x8b38d407a078c746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f243 expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219748.741859:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c74d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f243 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219748.741869:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:1.0:1785219748.741872:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785219748.741876:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476000, rc 0) 00000100:00100000:1.0:1785219748.742018:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:5604:x1871938444069888:12345-192.168.203.31@tcp:101: Request processed in 1391us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219748.742027:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1785219748.782539:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465061760:0@lo:400: 00000100:00100000:1.0:1785219748.782593:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465062144:0@lo:400: 00000100:00100000:3.0:1785219748.782661:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465062016:0@lo:400: 00000100:00100000:1.0:1785219748.784391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219748.784623:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465061888:0@lo:400: 00000100:00100000:1.0:1785219748.784664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219748.784688:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465062400:0@lo:400: 00000100:00100000:1.0:1785219748.784718:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219748.785439:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062144 00000100:00100000:2.0:1785219748.785451:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062144 00000100:00100000:2.0:1785219748.785522:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062400 00000100:00100000:2.0:1785219748.785526:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062400 00000100:00100000:2.0:1785219748.785549:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219748.785558:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465062144:12345-0@lo:400: 00000100:00100000:2.0:1785219748.785644:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465062144:12345-0@lo:400: Request processed in 87us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219748.785653:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219748.785673:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785219748.785679:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465062400:12345-0@lo:400: 00000100:00100000:2.0:1785219748.785714:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465062400:12345-0@lo:400: Request processed in 36us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219748.785720:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1785219748.785738:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219748.785742:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219748.785898:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465061888 00000100:00100000:1.0:1785219748.785904:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465061888 00000100:00100000:1.0:1785219748.786017:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785219748.786026:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465061888:12345-0@lo:400: 00000100:00100000:1.0:1785219748.786067:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465061888:12345-0@lo:400: Request processed in 43us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219748.786074:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1785219748.786126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c5500 x1871938465062144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219748.786144:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465062144:0@lo:400: 00010000:00080000:2.0:1785219748.786317:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c4700 x1871938465062400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219748.786330:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1785219748.786344:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465062400:0@lo:400: 00000100:00100000:2.0:1785219748.786400:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465061888:0@lo:400: 00000100:00100000:3.0:1785219748.787084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219748.787084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219748.787150:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465062272:0@lo:400: 00000100:00100000:0.0:1785219748.787189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219748.787439:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465061760 00000100:00100000:2.0:1785219748.787449:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465061760 00000100:00100000:3.0:1785219748.787490:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062016 00000100:00100000:3.0:1785219748.787496:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062016 00000100:00100000:2.0:1785219748.787507:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1785219748.787518:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465061760:12345-0@lo:400: 00000100:00100000:3.0:1785219748.787543:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062272 00000100:00100000:3.0:1785219748.787548:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062272 00000100:00100000:3.0:1785219748.787569:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785219748.787578:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465062016:12345-0@lo:400: 00000100:00100000:2.0:1785219748.787596:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465061760:12345-0@lo:400: Request processed in 80us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219748.787605:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1785219748.787640:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219748.787666:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1785219748.787675:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1785219748.787717:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465061760:0@lo:400: 00000100:00100000:1.0:1785219748.789027:0:5794:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1785219748.789057:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785219748.789072:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465062272:12345-0@lo:400: 00000100:00100000:1.0:1785219748.789179:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465062272:12345-0@lo:400: Request processed in 112us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219748.789186:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785219748.789424:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465062272:0@lo:400: 00000100:00100000:3.0:1785219748.789833:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465062016:12345-0@lo:400: Request processed in 2254us (2749us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219748.789842:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785219748.789893:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465062016:0@lo:400: 00010000:00010000:2.0:1785219749.227745:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219749.291745:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219749.291779:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465062528:0@lo:13: 00000100:00100000:2.0:1785219749.291892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219749.291934:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062528 00000100:00100000:1.0:1785219749.291946:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062528 00000100:00100000:1.0:1785219749.292026:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785219749.292038:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465062528:12345-0@lo:13: 00002000:00000024:1.0:1785219749.292069:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219749.292158:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465062528:12345-0@lo:13: Request processed in 122us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219749.292167:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1785219749.292310:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cef1c00 x1871938465062528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219749.292334:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465062528:0@lo:13: 00010000:00010000:3.0:1785219750.252276:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219750.831528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219750.831658:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070016 00000100:00100000:1.0:1785219750.831669:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070016 00000100:00100000:1.0:1785219750.831759:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00080000:2.0:1785219750.831770:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219750.831774:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:5656:x1871938444070016:12345-192.168.203.31@tcp:41: 00000004:00000024:1.0:1785219750.831832:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785219750.831908:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:5656:x1871938444070016:12345-192.168.203.31@tcp:41: Request processed in 139us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219750.831915:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1785219750.835394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219750.835610:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070144 00000100:00100000:1.0:1785219750.835619:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070144 00000100:00100000:1.0:1785219750.835691:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1785219750.835701:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5656:x1871938444070144:12345-192.168.203.31@tcp:13: 00002000:00000024:1.0:1785219750.835737:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219750.835805:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5656:x1871938444070144:12345-192.168.203.31@tcp:13: Request processed in 105us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219750.835813:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00080000:2.0:1785219750.836016:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219750.838474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219750.838750:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070272 00000100:00100000:1.0:1785219750.838759:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070272 00000100:00100000:1.0:1785219750.838839:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1785219750.838849:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5656:x1871938444070272:12345-192.168.203.31@tcp:13: 00002000:00000024:1.0:1785219750.838899:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219750.838965:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:5656:x1871938444070272:12345-192.168.203.31@tcp:13: Request processed in 117us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219750.838989:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00080000:2.0:1785219750.839120:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785219751.277121:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219751.341043:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219751.341069:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465062656:0@lo:13: 00000100:00100000:3.0:1785219751.341154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219751.341217:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062656 00000100:00100000:3.0:1785219751.341225:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062656 00000100:00100000:3.0:1785219751.341282:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785219751.341292:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465062656:12345-0@lo:13: 00002000:00000024:3.0:1785219751.341316:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219751.341397:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465062656:12345-0@lo:13: Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219751.341415:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1785219751.341436:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785219751.341464:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cef3800 x1871938465062656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219751.341481:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465062656:0@lo:13: 00000001:00100000:0.0:1785219751.949606:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00010000:00010000:3.0:1785219752.299593:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785219752.952976:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000001:00100000:3.0:1785219752.958422:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00010000:00010000:3.0:1785219753.326072:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785219753.345010:0:8146:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1785219753.899676:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465063040:0@lo:400: 00000100:00100000:2.0:1785219753.899769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219753.900051:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785219753.900060:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465062912:0@lo:400: 00000100:00100000:2.0:1785219753.900088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219753.900105:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465063424:0@lo:400: 00000100:00100000:2.0:1785219753.900129:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219753.900293:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465063040 00000100:00100000:2.0:1785219753.900301:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465063040 00000100:00100000:2.0:1785219753.900358:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062912 00000100:00100000:2.0:1785219753.900388:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062912 00000100:00100000:2.0:1785219753.900432:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785219753.900441:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465063040:12345-0@lo:400: 00000100:00100000:2.0:1785219753.900495:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465063040:12345-0@lo:400: Request processed in 55us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219753.900502:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785219753.900520:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785219753.900526:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465062912:12345-0@lo:400: 00000100:00100000:2.0:1785219753.900555:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465062912:12345-0@lo:400: Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219753.900561:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785219753.900582:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465063424 00000100:00100000:2.0:1785219753.900586:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465063424 00000100:00100000:2.0:1785219753.900615:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785219753.900622:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465063424:12345-0@lo:400: 00000100:00100000:2.0:1785219753.900653:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465063424:12345-0@lo:400: Request processed in 32us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219753.900659:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1785219753.900673:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219753.900771:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219753.900816:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465062912:0@lo:400: 00010000:00080000:2.0:1785219753.900828:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c6d80 x1871938465063424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219753.901271:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465063424:0@lo:400: 00000100:00100000:2.0:1785219753.901288:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465063040:0@lo:400: 00000100:00100000:3.0:1785219753.902596:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465062784:0@lo:400: 00000100:00100000:3.0:1785219753.902669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219753.902723:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465063296:0@lo:400: 00000100:00100000:3.0:1785219753.902751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219753.902797:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219753.902804:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465063168:0@lo:400: 00000100:00100000:3.0:1785219753.902832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219753.902977:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465063296 00000100:00100000:0.0:1785219753.902985:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465063296 00000100:00100000:0.0:1785219753.903033:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785219753.903042:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465063296:12345-0@lo:400: 00000100:00100000:0.0:1785219753.903092:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465063296:12345-0@lo:400: Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219753.903098:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785219753.903863:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465063296:0@lo:400: 00000100:00100000:2.0:1785219753.904551:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465062784 00000100:00100000:2.0:1785219753.904559:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465062784 00000100:00100000:2.0:1785219753.904629:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1785219753.904637:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465062784:12345-0@lo:400: 00000100:00100000:2.0:1785219753.904766:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465062784:12345-0@lo:400: Request processed in 120us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219753.904773:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1785219753.904810:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219753.905094:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465063168 00000100:00100000:0.0:1785219753.905100:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465063168 00000100:00080000:2.0:1785219753.905284:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219753.905300:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785219753.905309:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465063168:12345-0@lo:400: 00000100:00100000:2.0:1785219753.905353:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465063168:12345-0@lo:400: Request processed in 46us (2520us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219753.905359:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1785219753.906054:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c7100 x1871938465063168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219753.906070:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465063168:0@lo:400: 00000100:00100000:3.0:1785219753.906081:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465062784:0@lo:400: 00000100:00100000:3.0:1785219754.010566:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219754.010695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219754.010733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219754.010812:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219754.010877:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070528 00000100:00100000:1.0:1785219754.010894:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070528 00000100:00100000:1.0:1785219754.011007:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1785219754.011133:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444070528:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1785219754.011214:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444070528:12345-192.168.203.31@tcp:400: Request processed in 87us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219754.011222:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00080000:3.0:1785219754.011975:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219754.012504:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070656 00000100:00100000:1.0:1785219754.012516:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070656 00000100:00080000:3.0:1785219754.012613:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219754.016646:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070400 00000100:00100000:0.0:1785219754.016702:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070400 00000100:00100000:0.0:1785219754.016832:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:0.0:1785219754.016846:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444070400:12345-192.168.203.31@tcp:400: 00000100:00100000:0.0:1785219754.016966:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444070400:12345-192.168.203.31@tcp:400: Request processed in 122us (6415us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219754.016974:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1785219754.021348:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070784 00000100:00100000:2.0:1785219754.021377:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070784 00000100:00100000:2.0:1785219754.021460:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1785219754.021469:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444070656:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1785219754.021545:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444070656:12345-192.168.203.31@tcp:400: Request processed in 77us (10849us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219754.021551:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1785219754.021572:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1785219754.021580:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1785219754.021582:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444070784:12345-192.168.203.31@tcp:400: 00000100:00100000:0.0:1785219754.021607:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1785219754.021621:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444070784:12345-192.168.203.31@tcp:400: Request processed in 41us (10807us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219754.021628:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00080000:3.0:1785219754.026352:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785219754.351376:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219754.412409:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785219754.412435:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465063552:0@lo:13: 00000100:00100000:1.0:1785219754.412513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219754.412730:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465063552 00000100:00100000:3.0:1785219754.412737:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465063552 00000100:00100000:3.0:1785219754.412794:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785219754.412803:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465063552:12345-0@lo:13: 00002000:00000024:3.0:1785219754.412840:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219754.412894:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465063552:12345-0@lo:13: Request processed in 92us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219754.412901:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1785219754.413387:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348064000 x1871938465063552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219754.413408:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465063552:0@lo:13: 00010000:00010000:3.0:1785219755.380697:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219756.396948:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219756.460506:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465063680:0@lo:13: 00000100:00100000:3.0:1785219756.460575:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219756.460679:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465063680 00000100:00100000:1.0:1785219756.460688:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465063680 00000100:00080000:3.0:1785219756.460736:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219756.460777:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785219756.460788:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465063680:12345-0@lo:13: 00002000:00000024:1.0:1785219756.460823:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219756.460874:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465063680:12345-0@lo:13: Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219756.460881:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1785219756.461403:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cef0700 x1871938465063680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219756.461424:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465063680:0@lo:13: 00000020:00000080:0.0:1785219757.048166:0:8295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5f34e100 20000000:00000080:0.0:1785219757.048183:0:8295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf351eca400 uarg=0000000000000000 20000000:01000000:0.0:1785219757.048217:0:8295:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1785219757.048220:0:8295:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1785219757.048222:0:8295:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1785219757.048226:0:8295:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1785219757.048232:0:8295:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1785219757.048246:0:8295:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1785219757.048248:0:8295:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1785219757.050614:0:8295:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1785219757.050621:0:8295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1785219757.051711:0:8296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1785219757.052951:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1785219757.053027:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1785219757.053069:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1785219757.053084:0:8295:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1785219757.053087:0:8295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1785219757.055249:0:8297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1785219757.055793:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1785219757.055850:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1785219757.055905:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1785219757.055921:0:8295:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1785219757.055924:0:8295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1785219757.056730:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1785219757.057137:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1785219757.057207:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1785219757.057247:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1785219757.057270:0:8295:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1785219757.057273:0:8295:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1785219757.058177:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1785219757.058581:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1785219757.058647:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1785219757.058690:0:8295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1785219757.058709:0:8295:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1785219757.058729:0:8295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058759:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c64a expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058768:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c674 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058775:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c69e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058782:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058789:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058796:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058802:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c700 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058811:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058830:0:8295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058838:0:8295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058876:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.058891:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 9 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.058907:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465063808:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219757.059167:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.059176:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 9 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.059185:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465063936:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219757.059220:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c700 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.059229:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c700 expref: 18 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.059239:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064064:0@lo:104: 00000100:00100000:3.0:1785219757.059280:0:8295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785219757.059321:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.059329:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 18 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.059337:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064192:0@lo:104: 00000100:00100000:3.0:1785219757.059430:0:8295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785219757.063547:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.063566:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 18 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.063582:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064320:0@lo:104: 00010000:00010000:3.0:1785219757.063642:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.063650:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 18 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.063658:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064448:0@lo:104: 00010000:00010000:3.0:1785219757.063704:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c69e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.063712:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c69e expref: 18 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.063719:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064576:0@lo:104: 00010000:00010000:3.0:1785219757.063757:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c674 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.063772:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c674 expref: 18 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.063780:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064704:0@lo:104: 00010000:00010000:3.0:1785219757.063806:0:8295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c64a expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.063813:0:8295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c64a expref: 18 pid: 5788 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.063821:0:8295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064832:0@lo:104: 00000100:00100000:3.0:1785219757.063837:0:8295:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219757.063931:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1785219757.063960:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.063990:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.063999:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.064017:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.064025:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.064034:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064064 00000100:00100000:0.0:1785219757.064040:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064064 00000100:00100000:0.0:1785219757.064079:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064192 00000100:00100000:0.0:1785219757.064082:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064192 00000100:00100000:0.0:1785219757.064091:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064320 00000100:00100000:0.0:1785219757.064093:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064320 00000100:00100000:0.0:1785219757.064100:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064448 00000100:00100000:0.0:1785219757.064102:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064448 00000100:00100000:0.0:1785219757.064109:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064576 00000100:00100000:0.0:1785219757.064110:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064576 00000100:00100000:0.0:1785219757.064117:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064704 00000100:00100000:0.0:1785219757.064119:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064704 00000100:00100000:0.0:1785219757.064126:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064832 00000100:00100000:0.0:1785219757.064128:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064832 00000100:00100000:0.0:1785219757.064141:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785219757.064148:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+9:8295:x1871938465064064:12345-0@lo:104: 00010000:00010000:0.0:1785219757.064160:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064215:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785219757.064221:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+9:8295:x1871938465064064:12345-0@lo:104: Request processed in 74us (4942us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.064228:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785219757.064245:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219757.064251:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3810e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+8:8295:x1871938465064192:12345-0@lo:104: 00010000:00010000:0.0:1785219757.064259:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064298:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1785219757.064309:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3810e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+8:8295:x1871938465064192:12345-0@lo:104: Request processed in 59us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.064315:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219757.064386:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219757.064393:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+7:8295:x1871938465064320:12345-0@lo:104: 00010000:00010000:0.0:1785219757.064400:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064428:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1785219757.064432:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+7:8295:x1871938465064320:12345-0@lo:104: Request processed in 41us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.064438:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219757.064450:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785219757.064456:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+6:8295:x1871938465064448:12345-0@lo:104: 00010000:00010000:0.0:1785219757.064463:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064488:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1785219757.064494:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+6:8295:x1871938465064448:12345-0@lo:104: Request processed in 39us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.064499:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785219757.064511:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785219757.064517:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:8295:x1871938465064576:12345-0@lo:104: 00010000:00010000:0.0:1785219757.064524:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064549:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1785219757.064560:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:8295:x1871938465064576:12345-0@lo:104: Request processed in 43us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.064566:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785219757.064578:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785219757.064584:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+4:8295:x1871938465064704:12345-0@lo:104: 00010000:00010000:0.0:1785219757.064592:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064619:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1785219757.064624:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+4:8295:x1871938465064704:12345-0@lo:104: Request processed in 41us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.064629:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785219757.064641:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785219757.064647:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+3:8295:x1871938465064832:12345-0@lo:104: 00010000:00010000:0.0:1785219757.064655:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064680:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1785219757.064685:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+3:8295:x1871938465064832:12345-0@lo:104: Request processed in 39us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.064691:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1785219757.064710:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1785219757.064715:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064723:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341477a00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219757.064728:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064758:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219757.064765:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219757.064771:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219757.064800:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064806:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219757.064824:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064830:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341477a00/0x8b38d407a078c700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064846:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1785219757.064849:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064855:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031200 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219757.064858:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064863:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219757.064869:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219757.064880:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219757.064894:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064900:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219757.064914:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064920:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf340031200/0x8b38d407a078c6d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6dd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064930:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1785219757.064933:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064938:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030a00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219757.064941:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064948:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219757.064955:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219757.064960:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219757.064973:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064979:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219757.064990:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.064997:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf340030a00/0x8b38d407a078c6ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065007:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1785219757.065010:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065016:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06c00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219757.065018:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065025:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219757.065031:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219757.065036:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219757.065050:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065055:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219757.065060:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065066:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f06c00/0x8b38d407a078c6ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065074:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785219757.065082:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065087:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06e00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219757.065090:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065097:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219757.065103:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219757.065108:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219757.065122:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065128:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219757.065132:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065138:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f06e00/0x8b38d407a078c69e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c6a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065147:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785219757.065149:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065155:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341477000 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219757.065158:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065175:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219757.065182:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219757.065187:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219757.065212:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065219:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219757.065223:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065230:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c67b expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065240:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219757.065243:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065248:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030c00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219757.065251:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065258:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219757.065263:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219757.065274:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219757.065289:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065294:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219757.065299:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065304:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf340030c00/0x8b38d407a078c64a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c651 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065317:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219757.065319:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219757.065321:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219757.065335:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465065344:0@lo:103: 00000100:00100000:0.0:1785219757.065395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.065430:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785219757.065437:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465064960:0@lo:103: 00000100:00100000:0.0:1785219757.065458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.065476:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465065472:0@lo:103: 00000100:00100000:0.0:1785219757.065495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.065520:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065216:0@lo:103: 00000100:00100000:0.0:1785219757.065543:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.065559:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065728:0@lo:103: 00000100:00100000:0.0:1785219757.065579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.065589:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1785219757.065595:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065088:0@lo:103: 00000100:00100000:0.0:1785219757.065624:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.065634:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065600:0@lo:103: 00000100:00100000:0.0:1785219757.065659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219757.065680:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065344 00000100:00100000:0.0:1785219757.065685:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065344 00010000:00010000:0.0:1785219757.065710:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 19 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219757.065728:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465064960 00000100:00100000:0.0:1785219757.065730:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465064960 00010000:00010000:0.0:1785219757.065754:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c700 expref: 20 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219757.065766:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065472 00000100:00100000:0.0:1785219757.065769:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065472 00010000:00010000:0.0:1785219757.065779:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c69e expref: 21 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219757.065789:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065216 00000100:00100000:0.0:1785219757.065791:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065216 00010000:00010000:0.0:1785219757.065800:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 22 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219757.065810:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065728 00000100:00100000:0.0:1785219757.065813:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065728 00010000:00010000:0.0:1785219757.065822:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c64a expref: 23 pid: 5788 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219757.065831:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065088 00000100:00100000:0.0:1785219757.065834:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065088 00010000:00010000:0.0:1785219757.065843:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 24 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219757.065867:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065600 00000100:00100000:0.0:1785219757.065870:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065600 00010000:00010000:0.0:1785219757.065882:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c674 expref: 25 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219757.065895:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785219757.065902:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+25:3306:x1871938465065344:12345-0@lo:103: 00010000:00010000:0.0:1785219757.065914:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219757.065920:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 25 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065929:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 25 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.065946:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219757.065978:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+25:3306:x1871938465065344:12345-0@lo:103: Request processed in 76us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.065984:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785219757.065999:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219757.066005:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+24:3306:x1871938465064960:12345-0@lo:103: 00010000:00010000:0.0:1785219757.066012:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219757.066016:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c700 expref: 24 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066024:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c700 expref: 24 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066033:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219757.066059:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+24:3306:x1871938465064960:12345-0@lo:103: Request processed in 55us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.066065:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219757.066078:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219757.066083:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+23:3306:x1871938465065472:12345-0@lo:103: 00010000:00010000:0.0:1785219757.066090:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219757.066094:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c69e expref: 23 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066102:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c69e expref: 23 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066111:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219757.066131:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+23:3306:x1871938465065472:12345-0@lo:103: Request processed in 48us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.066136:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219757.066149:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785219757.066154:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+22:3309:x1871938465065216:12345-0@lo:103: 00010000:00010000:0.0:1785219757.066160:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219757.066164:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 22 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066171:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 22 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066179:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219757.066201:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+22:3309:x1871938465065216:12345-0@lo:103: Request processed in 47us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.066206:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785219757.066225:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785219757.066231:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+21:3309:x1871938465065728:12345-0@lo:103: 00010000:00010000:0.0:1785219757.066237:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219757.066242:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c64a expref: 21 pid: 5788 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066250:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c64a expref: 21 pid: 5788 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066259:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219757.066280:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+21:3309:x1871938465065728:12345-0@lo:103: Request processed in 50us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.066286:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785219757.066297:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785219757.066303:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+20:3309:x1871938465065088:12345-0@lo:103: 00010000:00010000:0.0:1785219757.066310:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219757.066314:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 20 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066322:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 20 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066330:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219757.066350:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+20:3309:x1871938465065088:12345-0@lo:103: Request processed in 47us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.066356:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785219757.066400:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785219757.066407:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465065600:12345-0@lo:103: 00010000:00010000:0.0:1785219757.066415:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219757.066425:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c674 expref: 19 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066433:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c674 expref: 19 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219757.066442:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219757.066464:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465065600:12345-0@lo:103: Request processed in 58us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219757.066470:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785219757.066526:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065088:0@lo:103: 00000100:00100000:0.0:1785219757.066534:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065600:0@lo:103: 00000100:00100000:0.0:1785219757.066541:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065216:0@lo:103: 00000100:00100000:0.0:1785219757.066548:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465065728:0@lo:103: 00000100:00100000:0.0:1785219757.066579:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465064960:0@lo:103: 00000100:00100000:0.0:1785219757.066586:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465065472:0@lo:103: 00000100:00100000:0.0:1785219757.066593:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465065344:0@lo:103: 00010000:00010000:2.0:1785219757.067027:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c700 expref: 18 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067058:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064064:0@lo:104: 00010000:00010000:2.0:1785219757.067072:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf340031a00/0x8b38d407a078c6dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c6d6 expref: 17 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067082:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064192:0@lo:104: 00010000:00010000:2.0:1785219757.067091:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c6c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c6ba expref: 16 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067097:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064320:0@lo:104: 00010000:00010000:2.0:1785219757.067106:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c6b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c6ac expref: 15 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067113:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064448:0@lo:104: 00010000:00010000:2.0:1785219757.067121:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c6a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c69e expref: 14 pid: 5785 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067127:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064576:0@lo:104: 00010000:00010000:2.0:1785219757.067136:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341477e00/0x8b38d407a078c67b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c674 expref: 13 pid: 5787 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067144:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064704:0@lo:104: 00010000:00010000:2.0:1785219757.067153:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81200/0x8b38d407a078c651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c64a expref: 12 pid: 5788 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067160:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465064832:0@lo:104: 00000100:00100000:2.0:1785219757.067631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219757.067676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219757.067697:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071040 00000100:00100000:2.0:1785219757.067703:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071040 00010000:00010000:2.0:1785219757.067733:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 10 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067764:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444070912 00000100:00100000:2.0:1785219757.067767:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444070912 00010000:00010000:2.0:1785219757.067778:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 11 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219757.067789:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1785219757.067796:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2361:x1871938444071040:12345-192.168.203.31@tcp:103: 00010000:00010000:2.0:1785219757.067806:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219757.067811:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 11 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067819:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 11 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067835:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219757.067877:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2361:x1871938444071040:12345-192.168.203.31@tcp:103: Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219757.067885:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:2.0:1785219757.067899:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1785219757.067905:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444070912:12345-192.168.203.31@tcp:103: 00010000:00010000:2.0:1785219757.067913:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219757.067917:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 10 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067932:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 10 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067944:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067952:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067967:0:6603:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067974:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067981:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067988:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.067995:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219757.068000:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.068008:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.068017:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.068038:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219757.068058:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444070912:12345-192.168.203.31@tcp:103: Request processed in 153us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219757.068064:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00010000:00010000:3.0:1785219757.068218:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c71c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e8 expref: 9 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.068230:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465063808:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219757.068240:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07600/0x8b38d407a078c715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f1e1 expref: 8 pid: 5785 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219757.068248:0:8295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8295:1871938465063936:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219757.068288:0:8295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.068298:0:8295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.068304:0:8295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219757.068317:0:8295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c754 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219757.069491:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219757.419689:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785219758.187705:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1785219758.187717:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf37e4b1000 from 39 10000000:01000000:2.0:1785219758.187725:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1785219758.189299:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.189444:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.189454:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219758.189484:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465065856:0@lo:101: 00000100:00100000:2.0:1785219758.189578:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219758.189652:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219758.190229:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065856 00000100:00100000:3.0:1785219758.190239:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065856 00000100:00100000:3.0:1785219758.190297:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1785219758.190318:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+12:5790:x1871938465065856:12345-0@lo:101: 00010000:00010000:3.0:1785219758.190336:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219758.190355:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c75b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.190546:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c75b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.190559:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c75b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.190568:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07000, rc 0) 00000100:00100000:3.0:1785219758.190624:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465065856:12345-0@lo:101: Request processed in 308us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.190631:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1785219758.190922:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465065856:0@lo:101: 00010000:00010000:2.0:1785219758.190938:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.190948:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219758.191035:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465065984:0@lo:501: 00000100:00100000:2.0:1785219758.191490:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219758.191562:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.196378:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465065984 00000100:00100000:0.0:1785219758.196393:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465065984 00000100:00100000:0.0:1785219758.196465:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1785219758.196474:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465065984:12345-0@lo:501: 00000100:00100000:0.0:1785219758.196852:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465065984:12345-0@lo:501: Request processed in 378us (5361us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.196859:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1785219758.197254:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465065984:0@lo:501: 00000100:00100000:2.0:1785219758.197335:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066112:0@lo:503: 00000100:00100000:2.0:1785219758.197411:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.197439:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465066112 00000100:00100000:2.0:1785219758.197447:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219758.197457:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465066112 00000100:00100000:3.0:1785219758.197502:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1785219758.197510:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465066112:12345-0@lo:503: 00000100:00100000:3.0:1785219758.197821:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465066112:12345-0@lo:503: Request processed in 311us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.197837:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1785219758.198112:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066112:0@lo:503: 00000100:00100000:0.0:1785219758.198526:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8313:1871938465066240:0@lo:502: 00000100:00100000:0.0:1785219758.198569:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219758.198605:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a588c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219758.198787:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465066240 00000100:00100000:3.0:1785219758.198792:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465066240 00000100:00100000:3.0:1785219758.198861:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1785219758.198869:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:8313:x1871938465066240:12345-0@lo:502: 00000100:00100000:3.0:1785219758.199356:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:8313:x1871938465066240:12345-0@lo:502: Request processed in 486us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.199396:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1785219758.199471:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8313:1871938465066240:0@lo:502: 00000100:00100000:0.0:1785219758.199514:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8313:1871938465066368:0@lo:502: 00000100:00100000:0.0:1785219758.199547:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219758.200165:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465066368 00000100:00100000:2.0:1785219758.200171:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465066368 00000100:00100000:2.0:1785219758.200196:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1785219758.200203:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:8313:x1871938465066368:12345-0@lo:502: 00000100:00100000:2.0:1785219758.200900:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+13:8313:x1871938465066368:12345-0@lo:502: Request processed in 694us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.201436:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1785219758.201502:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a588c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.201523:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8313:1871938465066368:0@lo:502: 00000040:00080000:2.0:1785219758.201552:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1785219758.201671:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1785219758.201688:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785219758.201903:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.201917:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219758.201928:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1785219758.201932:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1785219758.201935:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1785219758.201968:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.201976:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.201985:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219758.202003:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066496:0@lo:101: 00000100:00100000:3.0:1785219758.202049:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.202079:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5540 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.202138:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465066496 00000100:00100000:0.0:1785219758.202144:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465066496 00000100:00100000:0.0:1785219758.202181:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1785219758.202188:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+13:5790:x1871938465066496:12345-0@lo:101: 00010000:00010000:0.0:1785219758.202199:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219758.202210:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cca00/0x8b38d407a078c770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c769 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.202231:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cca00/0x8b38d407a078c770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c769 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.202241:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cca00/0x8b38d407a078c770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c769 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.202249:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cca00, rc 0) 00000100:00100000:3.0:1785219758.202543:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066496:0@lo:101: 00010000:00010000:3.0:1785219758.202558:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.202568:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219758.202742:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066624:0@lo:501: 00000100:00100000:3.0:1785219758.202770:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.202796:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5540 going to sleep for 11 seconds 00000100:00100000:1.0:1785219758.203408:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465066624 00000100:00100000:1.0:1785219758.203415:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465066624 00000100:00100000:1.0:1785219758.203453:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1785219758.203462:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465066624:12345-0@lo:501: 00000100:00100000:1.0:1785219758.203741:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465066624:12345-0@lo:501: Request processed in 268us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219758.203749:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1785219758.204652:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465066496:12345-0@lo:101: Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.204666:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1785219758.205429:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066624:0@lo:501: 00000100:00100000:3.0:1785219758.205483:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066752:0@lo:503: 00000100:00100000:3.0:1785219758.205543:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.205578:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5540 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.206001:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465066752 00000100:00100000:2.0:1785219758.206008:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465066752 00000100:00100000:2.0:1785219758.206054:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1785219758.206063:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465066752:12345-0@lo:503: 00000100:00100000:2.0:1785219758.206268:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465066752:12345-0@lo:503: Request processed in 206us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.206275:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1785219758.206465:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465066752:0@lo:503: 00000100:00100000:1.0:1785219758.207553:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8314:1871938465066880:0@lo:502: 00000100:00100000:1.0:1785219758.207602:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.207638:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf377bd40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.207774:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465066880 00000100:00100000:0.0:1785219758.207781:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465066880 00000100:00100000:0.0:1785219758.207821:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1785219758.207829:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:8314:x1871938465066880:12345-0@lo:502: 00000100:00100000:0.0:1785219758.208028:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:8314:x1871938465066880:12345-0@lo:502: Request processed in 199us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.208036:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1785219758.208290:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8314:1871938465066880:0@lo:502: 00000020:01000000:1.0:1785219758.208387:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219758.208395:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219758.208398:0:8314:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1785219758.208403:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1785219758.208424:0:8314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8314:1871938465067008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219758.208454:0:8314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.208469:0:8314:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf377bd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.208561:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067008 00000100:00100000:2.0:1785219758.208572:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067008 00000100:00100000:2.0:1785219758.208613:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1785219758.208620:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:8314:x1871938465067008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219758.208960:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+14:8314:x1871938465067008:12345-0@lo:502:llog_process_th.0 Request processed in 340us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.208968:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1785219758.214642:0:8314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8314:1871938465067008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219758.214692:0:8314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219758.214703:0:8314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219758.214705:0:8314:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1785219758.214712:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1785219758.214803:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1785219758.214869:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1785219758.214881:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.214892:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219758.214903:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785219758.214906:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf349c7c000 from 39 10000000:01000000:0.0:1785219758.214909:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785219758.214946:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.214955:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.214964:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219758.214985:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785219758.215046:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.215088:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067136 00000100:00100000:0.0:1785219758.215089:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a588600 going to sleep for 11 seconds 00000100:00100000:3.0:1785219758.215097:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067136 00000100:00100000:3.0:1785219758.215149:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1785219758.215157:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:5790:x1871938465067136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219758.215182:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219758.215194:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06200/0x8b38d407a078c77e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c777 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.215217:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06200/0x8b38d407a078c77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c777 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.215226:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06200/0x8b38d407a078c77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c777 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.215235:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06200, rc 0) 00000100:00100000:3.0:1785219758.215273:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465067136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.215280:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1785219758.215321:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219758.215334:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.215351:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219758.215429:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219758.215455:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219758.215479:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a588600 going to sleep for 11 seconds 00000100:00100000:1.0:1785219758.215612:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067264 00000100:00100000:1.0:1785219758.215618:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067264 00000100:00100000:1.0:1785219758.215651:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1785219758.215658:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465067264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.215977:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465067264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219758.215984:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1785219758.216044:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219758.216073:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219758.216112:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219758.216133:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a588600 going to sleep for 11 seconds 00000100:00100000:3.0:1785219758.217245:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067392 00000100:00100000:3.0:1785219758.217253:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067392 00000100:00100000:3.0:1785219758.217743:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1785219758.217754:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465067392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.217979:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465067392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.217994:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1785219758.218007:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.219931:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8315:1871938465067520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219758.220004:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.220060:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371b109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.220185:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067520 00000100:00100000:0.0:1785219758.220192:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067520 00000100:00100000:0.0:1785219758.220232:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1785219758.220241:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:8315:x1871938465067520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219758.220493:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:8315:x1871938465067520:12345-0@lo:502:llog_process_th.0 Request processed in 252us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.220501:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1785219758.221948:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8315:1871938465067520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219758.222023:0:8315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8315:1871938465067648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219758.222079:0:8315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219758.222121:0:8315:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1785219758.222236:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067648 00000100:00100000:3.0:1785219758.222242:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067648 00000100:00100000:3.0:1785219758.222285:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1785219758.222294:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:8315:x1871938465067648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219758.222539:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:8315:x1871938465067648:12345-0@lo:502:llog_process_th.0 Request processed in 245us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.222557:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1785219758.223808:0:8315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8315:1871938465067648:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1785219758.223846:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1785219758.224517:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1785219758.224539:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785219758.224550:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.224563:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219758.224574:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1785219758.224577:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1785219758.224580:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1785219758.224620:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.224627:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.224636:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219758.224657:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.224707:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.224794:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219758.228234:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067776 00000100:00100000:3.0:1785219758.228250:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067776 00000100:00100000:2.0:1785219758.229490:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1785219758.229507:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+15:5790:x1871938465067776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219758.229525:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219758.229544:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c78c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c785 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.229572:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c78c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c785 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.229583:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c78c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c785 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.229592:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81000, rc 0) 00000100:00100000:2.0:1785219758.229682:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465067776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.229702:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1785219758.229856:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785219758.229875:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.229896:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219758.229968:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.230001:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.230040:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.230108:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465067904 00000100:00100000:0.0:1785219758.230113:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465067904 00000100:00100000:0.0:1785219758.230151:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1785219758.230158:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465067904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219758.230440:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465067904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.230447:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1785219758.230713:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465067904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.230756:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.230794:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.230855:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.244595:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068032 00000100:00100000:2.0:1785219758.244609:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068032 00000100:00100000:2.0:1785219758.244672:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1785219758.244682:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465068032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219758.244947:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465068032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (14152us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.244955:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1785219758.245039:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.245454:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8316:1871938465068160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219758.245497:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.245527:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.245598:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068160 00000100:00100000:2.0:1785219758.245604:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068160 00000100:00100000:2.0:1785219758.245637:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1785219758.245644:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:8316:x1871938465068160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219758.245819:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:8316:x1871938465068160:12345-0@lo:502:llog_process_th.0 Request processed in 172us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.245826:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1785219758.246100:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8316:1871938465068160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785219758.246123:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219758.246132:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219758.246135:0:8316:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1785219758.246141:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1785219758.246165:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8316:1871938465068288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219758.246199:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.246230:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.246246:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068288 00000100:00100000:0.0:1785219758.246250:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068288 00000100:00100000:0.0:1785219758.246282:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1785219758.246299:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:8316:x1871938465068288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219758.246469:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:8316:x1871938465068288:12345-0@lo:502:llog_process_th.0 Request processed in 180us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.246476:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1785219758.246571:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8316:1871938465068288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785219758.246589:0:8316:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219758.246593:0:8316:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219758.246595:0:8316:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1785219758.246598:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1785219758.246676:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1785219758.246694:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1785219758.246703:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.246714:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219758.246724:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785219758.246744:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf3503a5000 from 39 10000000:01000000:3.0:1785219758.246748:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785219758.246774:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.246781:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.246791:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219758.246805:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.246842:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.246872:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.246921:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068416 00000100:00100000:0.0:1785219758.246925:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068416 00000100:00100000:0.0:1785219758.246954:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1785219758.246961:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465068416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219758.246969:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219758.246981:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078c79a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c793 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.247001:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078c79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c793 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.247011:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078c79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c793 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.247020:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cd400, rc 0) 00000100:00100000:0.0:1785219758.247057:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465068416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.247063:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1785219758.247121:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219758.247133:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.247142:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219758.247184:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.247207:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.247229:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.247337:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068544 00000100:00100000:0.0:1785219758.247342:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068544 00000100:00100000:0.0:1785219758.247390:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1785219758.247396:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465068544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219758.247595:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465068544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.247602:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1785219758.247673:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.247698:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.247742:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.247761:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.247913:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068672 00000100:00100000:2.0:1785219758.247917:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068672 00000100:00100000:2.0:1785219758.247937:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1785219758.247943:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465068672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219758.248085:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465068672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.248092:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1785219758.248411:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465068672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.251378:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8317:1871938465068800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219758.251470:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.251509:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cab000 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.251636:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068800 00000100:00100000:0.0:1785219758.251643:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068800 00000100:00100000:0.0:1785219758.251689:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1785219758.251698:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8317:x1871938465068800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219758.251960:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8317:x1871938465068800:12345-0@lo:502:llog_process_th.0 Request processed in 263us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.251969:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1785219758.252121:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8317:1871938465068800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219758.252171:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8317:1871938465068928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219758.252206:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.252230:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cab000 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.252284:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465068928 00000100:00100000:0.0:1785219758.252633:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465068928 00000100:00100000:1.0:1785219758.256453:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1785219758.256467:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8317:x1871938465068928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219758.256783:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8317:x1871938465068928:12345-0@lo:502:llog_process_th.0 Request processed in 317us (4575us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219758.256792:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1785219758.256876:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8317:1871938465068928:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1785219758.256911:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1785219758.258405:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1785219758.258443:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785219758.258456:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.258469:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219758.258480:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1785219758.258483:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1785219758.258486:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1785219758.258526:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.258534:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.258562:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219758.258587:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.258648:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.258695:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cabe40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.258765:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069056 00000100:00100000:2.0:1785219758.258779:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069056 00000100:00100000:2.0:1785219758.258823:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1785219758.258832:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465069056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219758.258846:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219758.258857:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c7a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c7a1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.258880:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c7a1 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.258890:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7a1 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.258898:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81a00, rc 0) 00000100:00100000:2.0:1785219758.258951:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465069056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219758.258958:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1785219758.259150:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219758.259165:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219758.259173:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219758.259223:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.259260:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.259285:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.259338:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069184 00000100:00100000:0.0:1785219758.259343:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069184 00000100:00100000:0.0:1785219758.259398:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1785219758.259410:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465069184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219758.259654:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465069184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.259709:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.259749:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.259787:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.259802:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219758.259874:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069312 00000100:00100000:1.0:1785219758.259878:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069312 00000100:00100000:0.0:1785219758.264595:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1785219758.264918:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1785219758.264934:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465069312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.265182:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465069312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (5392us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219758.265189:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1785219758.265336:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219758.265838:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8318:1871938465069440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219758.265888:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.265928:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5480 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.266167:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069440 00000100:00100000:0.0:1785219758.266174:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069440 00000100:00100000:0.0:1785219758.266251:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1785219758.266262:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:8318:x1871938465069440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219758.267516:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:8318:x1871938465069440:12345-0@lo:502:llog_process_th.0 Request processed in 1252us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219758.267566:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8318:1871938465069440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219758.267601:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219758.267610:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219758.267613:0:8318:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1785219758.267619:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1785219758.267647:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8318:1871938465069568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219758.267689:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219758.267712:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5480 going to sleep for 11 seconds 00000100:00100000:1.0:1785219758.267814:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069568 00000100:00100000:1.0:1785219758.267820:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069568 00000100:00100000:1.0:1785219758.267861:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1785219758.267869:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:8318:x1871938465069568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219758.267892:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1785219758.268196:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:8318:x1871938465069568:12345-0@lo:502:llog_process_th.0 Request processed in 326us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219758.268203:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1785219758.268336:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8318:1871938465069568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219758.268355:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219758.268361:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219758.268473:0:8318:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1785219758.268478:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1785219758.268702:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1785219758.268719:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785219758.268739:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.268751:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219758.268769:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1785219758.268772:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf3486699c0 from 1 10000000:01000000:1.0:1785219758.268774:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785219758.268802:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.268810:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219758.268819:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219758.268834:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.268865:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.268933:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350cab180 going to sleep for 11 seconds 00000100:00100000:0.0:1785219758.268962:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069696 00000100:00100000:0.0:1785219758.269109:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069696 00000100:00100000:0.0:1785219758.269177:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1785219758.269184:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465069696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219758.269195:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219758.269207:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cce00/0x8b38d407a078c7b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c7af expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.269228:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cce00/0x8b38d407a078c7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c7af expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.269238:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cce00/0x8b38d407a078c7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7af expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219758.269246:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cce00, rc 0) 00000100:00100000:0.0:1785219758.269289:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465069696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219758.269295:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1785219758.269358:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219758.269406:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7b6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.269415:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c7b6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219758.269464:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219758.269491:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219758.269794:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069824 00000100:00100000:1.0:1785219758.269800:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069824 00000100:00100000:1.0:1785219758.269821:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1785219758.269827:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465069824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219758.270473:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465069824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 644us (979us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785219758.270481:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1785219758.270594:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1785219758.270613:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465069824:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1785219758.270645:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1785219758.270654:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7b6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.270662:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7b6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219758.444131:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219759.019832:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465070080:0@lo:400:kworker.0 00000100:00100000:3.0:1785219759.019869:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465070336:0@lo:400:kworker.0 00000100:00100000:2.0:1785219759.019954:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465070208:0@lo:400:kworker.0 00000100:00100000:1.0:1785219759.020038:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465069952:0@lo:400:kworker.0 00000100:00100000:3.0:1785219759.023028:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219759.023173:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070336 00000100:00100000:3.0:1785219759.023202:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070336 00000100:00100000:3.0:1785219759.023496:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785219759.023510:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465070336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219759.023611:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465070336:12345-0@lo:400:kworker.0 Request processed in 105us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219759.023619:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1785219759.023647:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219759.023691:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465070336:0@lo:400:kworker.0 00000100:00100000:0.0:1785219759.026250:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219759.026859:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070080 00000100:00100000:3.0:1785219759.026873:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070080 00000100:00100000:3.0:1785219759.026963:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785219759.026973:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465070080:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785219759.027036:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219759.027071:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465070080:12345-0@lo:400:kworker.0 Request processed in 99us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219759.027080:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785219759.027358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219759.027697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219759.027749:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465070464:0@lo:400:kworker.0 00000100:00100000:1.0:1785219759.027788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219759.027851:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465069952 00000100:00100000:2.0:1785219759.027857:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465069952 00000100:00100000:2.0:1785219759.027893:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785219759.027901:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465069952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219759.027941:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465069952:12345-0@lo:400:kworker.0 Request processed in 40us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219759.027947:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785219759.028163:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465069952:0@lo:400:kworker.0 00000100:00100000:0.0:1785219759.028187:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465070080:0@lo:400:kworker.0 00000100:00100000:3.0:1785219759.028221:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070208 00000100:00100000:3.0:1785219759.028226:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070208 00000100:00080000:0.0:1785219759.030883:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219759.030980:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070464 00000100:00100000:2.0:1785219759.030993:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070464 00000100:00100000:2.0:1785219759.031095:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219759.031106:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465070208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219759.031230:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465070208:12345-0@lo:400:kworker.0 Request processed in 126us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219759.031237:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219759.031272:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785219759.031278:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465070464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219759.031318:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465070464:12345-0@lo:400:kworker.0 Request processed in 40us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219759.031344:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1785219759.031512:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785219759.031659:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f2d80 x1871938465070208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219759.031676:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465070208:0@lo:400:kworker.0 00010000:00080000:2.0:1785219759.031732:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f1180 x1871938465070464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219759.031743:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465070464:0@lo:400:kworker.0 00000100:00100000:2.0:1785219759.121037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219759.121103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219759.121139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219759.121174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219759.121211:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071552 00000100:00100000:2.0:1785219759.121224:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071552 00000100:00100000:2.0:1785219759.121309:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071424 00000100:00100000:2.0:1785219759.121313:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071424 00000100:00100000:2.0:1785219759.121345:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1785219759.121356:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444071552:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1785219759.121496:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444071552:12345-192.168.203.31@tcp:400: Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219759.121505:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1785219759.121531:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1785219759.121537:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2362:x1871938444071424:12345-192.168.203.31@tcp:400: 00000100:00100000:2.0:1785219759.121562:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2362:x1871938444071424:12345-192.168.203.31@tcp:400: Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219759.121590:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:0.0:1785219759.122302:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219759.122309:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785219759.123928:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071168 00000100:00100000:1.0:1785219759.123946:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071168 00000100:00100000:1.0:1785219759.124036:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:1.0:1785219759.124056:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:2362:x1871938444071168:12345-192.168.203.31@tcp:400: 00000100:00100000:1.0:1785219759.124157:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:2362:x1871938444071168:12345-192.168.203.31@tcp:400: Request processed in 111us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219759.124166:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:3.0:1785219759.124492:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071296 00000100:00100000:3.0:1785219759.124498:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071296 00000100:00100000:3.0:1785219759.124563:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1785219759.124571:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444071296:12345-192.168.203.31@tcp:400: 00000100:00100000:3.0:1785219759.124610:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444071296:12345-192.168.203.31@tcp:400: Request processed in 40us (3589us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219759.124616:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00080000:1.0:1785219759.124792:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785219759.469504:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219759.535429:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219759.535459:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465070592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219759.535558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219759.535821:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070592 00000100:00100000:0.0:1785219759.535832:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070592 00000100:00100000:0.0:1785219759.535932:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219759.535943:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465070592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785219759.535989:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219759.536059:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465070592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219759.536067:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1785219759.536147:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc30700 x1871938465070592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219759.536180:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465070592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785219760.492896:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219761.515651:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219761.579641:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465070720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219761.579903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219761.586207:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070720 00000100:00100000:3.0:1785219761.586231:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070720 00000100:00100000:3.0:1785219761.586338:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785219761.586387:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465070720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785219761.586446:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219761.586582:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465070720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (6679us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219761.586590:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1785219761.586843:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f3480 x1871938465070720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219761.586870:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465070720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785219761.587649:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785219762.539650:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219762.717828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219762.718002:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071680 00000100:00100000:3.0:1785219762.718012:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071680 00000100:00100000:3.0:1785219762.718105:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:3.0:1785219762.718116:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:5576:x1871938444071680:12345-192.168.203.31@tcp:101: 00010000:00010000:3.0:1785219762.718133:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219762.718164:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07e00/0x8b38d407a078c7bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f24a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219762.718193:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07e00/0x8b38d407a078c7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f24a expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219762.718475:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07e00/0x8b38d407a078c7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f24a expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219762.718487:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07e00, rc 0) 00000100:00100000:3.0:1785219762.718965:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5576:x1871938444071680:12345-192.168.203.31@tcp:101: Request processed in 436us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219762.718976:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:2.0:1785219762.723643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219762.723875:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071808 00000100:00100000:0.0:1785219762.723891:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071808 00000100:00100000:0.0:1785219762.723970:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:0.0:1785219762.723982:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5576:x1871938444071808:12345-192.168.203.31@tcp:501: 00000100:00100000:0.0:1785219762.724591:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5576:x1871938444071808:12345-192.168.203.31@tcp:501: Request processed in 610us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219762.724601:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:2.0:1785219762.742457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219762.742547:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444071936 00000100:00100000:3.0:1785219762.742558:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444071936 00000100:00100000:3.0:1785219762.742770:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:3.0:1785219762.742785:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5576:x1871938444071936:12345-192.168.203.31@tcp:503: 00000100:00100000:3.0:1785219762.743232:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5576:x1871938444071936:12345-192.168.203.31@tcp:503: Request processed in 449us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219762.743242:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1785219762.756060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219762.756239:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072064 00000100:00100000:0.0:1785219762.756252:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072064 00000100:00100000:0.0:1785219762.756341:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:0.0:1785219762.756353:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:6075:x1871938444072064:12345-192.168.203.31@tcp:502: 00000100:00100000:0.0:1785219762.756760:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:6075:x1871938444072064:12345-192.168.203.31@tcp:502: Request processed in 408us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219762.756769:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:2.0:1785219762.765600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219762.765729:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072192 00000100:00100000:3.0:1785219762.765740:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072192 00000100:00100000:3.0:1785219762.765806:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:3.0:1785219762.765818:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:6075:x1871938444072192:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785219762.766120:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:6075:x1871938444072192:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 303us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219762.766129:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:0.0:1785219762.773310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219762.773434:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072320 00000100:00100000:1.0:1785219762.773446:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072320 00000100:00100000:1.0:1785219762.773505:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:1.0:1785219762.773515:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5576:x1871938444072320:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785219762.773535:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219762.773553:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c7c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f251 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219762.773584:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f251 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219762.773598:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f251 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219762.773608:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476c00, rc 0) 00000100:00100000:1.0:1785219762.773670:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444072320:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 155us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219762.773677:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:0.0:1785219762.793589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219762.800053:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072448 00000100:00100000:1.0:1785219762.800068:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072448 00000100:00100000:1.0:1785219762.800138:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:1.0:1785219762.800149:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444072448:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219762.800450:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444072448:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 302us (6879us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785219762.800460:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00010000:00010000:0.0:1785219763.563683:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219764.141802:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465070848:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.141867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219764.141909:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465071360:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219764.143159:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785219764.143168:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465071232:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219764.143238:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465071104:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219764.143272:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785219764.143276:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465070976:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219764.143306:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465071488:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219764.143349:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070848 00000100:00100000:0.0:1785219764.143357:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070848 00000100:00100000:0.0:1785219764.143412:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1785219764.143419:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465070848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143464:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465070848:12345-0@lo:400:kworker.0 Request processed in 45us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219764.143472:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1785219764.143502:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465071360 00000100:00100000:0.0:1785219764.143505:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465071360 00000100:00100000:0.0:1785219764.143533:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465071104 00000100:00100000:0.0:1785219764.143536:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465071104 00000100:00100000:0.0:1785219764.143546:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465070976 00000100:00100000:0.0:1785219764.143548:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465070976 00000100:00100000:0.0:1785219764.143573:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785219764.143578:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465071360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143606:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465071360:12345-0@lo:400:kworker.0 Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219764.143612:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785219764.143621:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785219764.143626:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465071104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143649:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465071104:12345-0@lo:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219764.143654:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785219764.143664:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785219764.143668:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465070976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143701:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465070976:12345-0@lo:400:kworker.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219764.143707:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1785219764.143723:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219764.143757:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465070976:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143765:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465071104:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143789:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465070848:0@lo:400:kworker.0 00000100:00100000:0.0:1785219764.143797:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465071360:0@lo:400:kworker.0 00000100:00100000:2.0:1785219764.145656:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465071232 00000100:00100000:2.0:1785219764.145668:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465071232 00000100:00100000:2.0:1785219764.145730:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465071488 00000100:00100000:2.0:1785219764.145733:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465071488 00000100:00080000:0.0:1785219764.145747:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785219764.145751:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219764.145758:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785219764.145766:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465071232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219764.145861:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465071232:12345-0@lo:400:kworker.0 Request processed in 96us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219764.145868:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785219764.145882:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785219764.145888:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465071488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219764.145922:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465071488:12345-0@lo:400:kworker.0 Request processed in 35us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219764.145928:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1785219764.145979:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc32d80 x1871938465071488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219764.145994:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465071488:0@lo:400:kworker.0 00010000:00080000:0.0:1785219764.146045:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc33100 x1871938465071232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219764.146067:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465071232:0@lo:400:kworker.0 00000100:00100000:2.0:1785219764.248352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219764.248445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219764.248475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219764.248506:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219764.248537:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072960 00000100:00100000:2.0:1785219764.248548:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072960 00000100:00100000:2.0:1785219764.248603:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072832 00000100:00100000:2.0:1785219764.248606:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072832 00000100:00100000:2.0:1785219764.248631:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1785219764.248641:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444072960:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219764.248724:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444072960:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219764.248732:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1785219764.248748:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1785219764.248755:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444072832:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219764.248796:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444072832:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 42us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219764.248803:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00080000:0.0:1785219764.249262:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219764.249268:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785219764.249279:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072704 00000100:00100000:0.0:1785219764.249283:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072704 00000100:00100000:0.0:1785219764.249328:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1785219764.249335:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444072704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219764.249384:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444072704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219764.249390:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00080000:3.0:1785219764.249509:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219764.250047:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444072576 00000100:00100000:1.0:1785219764.250054:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444072576 00000100:00100000:1.0:1785219764.250096:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:1.0:1785219764.250104:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444072576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219764.250162:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444072576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 58us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219764.250169:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00010000:00010000:3.0:1785219764.589442:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219764.653444:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465071616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219764.653545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219764.654868:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465071616 00000100:00100000:3.0:1785219764.654883:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465071616 00000100:00100000:3.0:1785219764.654960:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785219764.654971:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465071616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219764.655020:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219764.655104:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465071616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219764.655112:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1785219764.655226:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f1c00 x1871938465071616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219764.655249:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465071616:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1785219764.789263:0:8356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb7b75130 20000000:00000080:1.0:1785219764.789280:0:8356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf245aef000 uarg=0000000000000000 20000000:01000000:1.0:1785219764.789313:0:8356:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785219764.789319:0:8356:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785219764.789323:0:8356:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1785219764.791876:0:8357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1785219764.792004:0:8356:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1785219764.799050:0:8356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1785219764.799098:0:8356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1785219764.799179:0:8356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1785219764.799196:0:8356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1785219764.799230:0:8356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799248:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c58d expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799257:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c60b expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799265:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c666 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799275:0:8356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799283:0:8356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799321:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799346:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 9 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.799380:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465071744:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219764.799489:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c666 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799499:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c666 expref: 18 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.799510:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465071872:0@lo:104: 00000100:00100000:2.0:1785219764.799550:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785219764.799604:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c60b expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799612:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c60b expref: 18 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.799621:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465072000:0@lo:104: 00000100:00100000:2.0:1785219764.799643:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785219764.799669:0:8356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c58d expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.799678:0:8356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c594 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c58d expref: 18 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.799699:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465072128:0@lo:104: 00000100:00100000:2.0:1785219764.799721:0:8356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785219764.799831:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785219764.799850:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219764.799877:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465071872 00000100:00100000:3.0:1785219764.799883:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465071872 00000100:00100000:1.0:1785219764.799889:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465072000 00000100:00100000:1.0:1785219764.799895:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465072000 00000100:00100000:3.0:1785219764.799926:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465072128 00000100:00100000:3.0:1785219764.799930:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465072128 00000100:00100000:1.0:1785219764.799931:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785219764.799962:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1785219764.799982:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3487e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:8356:x1871938465072000:12345-0@lo:104: 00010000:00010000:0.0:1785219764.800004:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219764.800027:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+5:8356:x1871938465071872:12345-0@lo:104: 00010000:00010000:1.0:1785219764.800044:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.800177:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465072000:0@lo:104: 00010000:00010000:1.0:1785219764.801727:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785219764.801740:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+5:8356:x1871938465071872:12345-0@lo:104: Request processed in 1789us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219764.801750:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465071872:0@lo:104: 00000100:00100000:1.0:1785219764.802622:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785219764.802656:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785219764.802667:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:8356:x1871938465072128:12345-0@lo:104: 00010000:00010000:1.0:1785219764.802694:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.802770:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1785219764.802776:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:8356:x1871938465072128:12345-0@lo:104: Request processed in 113us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219764.802782:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1785219764.802802:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785219764.802808:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.802817:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219764.802820:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.802829:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219764.802836:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219764.802855:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785219764.802893:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.802899:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219764.802924:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.802930:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf340030200/0x8b38d407a078c666 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c66d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.803005:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219764.803011:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.803017:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476400 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219764.803020:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.803026:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219764.803032:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219764.803038:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785219764.803052:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.803216:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465072128:0@lo:104: 00010000:00010000:1.0:1785219764.803230:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219764.803246:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.803253:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341476400/0x8b38d407a078c58d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c594 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.803264:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219764.803265:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219764.803267:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219764.803306:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219764.803346:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465072256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785219764.803347:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465072384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219764.803415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219764.803735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219764.803772:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465072256 00000100:00100000:1.0:1785219764.803780:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465072256 00010000:00010000:1.0:1785219764.803808:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c666 expref: 19 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.803816:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465072384 00000100:00100000:2.0:1785219764.803822:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465072384 00010000:00010000:2.0:1785219764.803840:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c594 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c58d expref: 20 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219764.803844:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785219764.803858:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+20:3308:x1871938465072256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219764.803869:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1785219764.803871:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1785219764.803877:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c666 expref: 20 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.803882:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+20:3309:x1871938465072384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219764.803897:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219764.803897:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c666 expref: 20 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.803905:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c594 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c58d expref: 20 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.803918:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341476800/0x8b38d407a078c66d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c666 expref: 20 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.803920:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c58d expref: 20 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.803943:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c594 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c58d expref: 19 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.803954:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219764.803982:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:3309:x1871938465072384:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219764.803988:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1785219764.804011:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219764.804054:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:3308:x1871938465072256:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219764.804075:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785219764.804085:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465072256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785219764.804161:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465072384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219764.805456:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219764.805488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219764.805514:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073088 00000100:00100000:2.0:1785219764.805532:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073088 00010000:00010000:2.0:1785219764.805558:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 10 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219764.805586:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1785219764.805594:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2362:x1871938444073088:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219764.805606:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219764.805611:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 10 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.805623:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 10 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219764.805639:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219764.805680:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2362:x1871938444073088:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 86us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219764.805700:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00010000:00010000:3.0:1785219764.805898:0:8356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07200/0x8b38d407a078c72a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f219 expref: 9 pid: 5785 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219764.805912:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8356:1871938465071744:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219764.805945:0:8356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219764.806063:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073216 00000100:00100000:1.0:1785219764.806070:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073216 00000100:00100000:1.0:1785219764.806117:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:1.0:1785219764.806125:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:5576:x1871938444073216:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785219764.806137:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219764.806152:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f258 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.806169:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219764.806171:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1785219764.806183:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219764.806185:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3487e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+3:8356:x1871938465072000:12345-0@lo:104: Request processed in 6207us (6536us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219764.806201:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1785219764.806209:0:5788:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.806238:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219764.806246:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341477a00, rc 0) 00000100:00100000:1.0:1785219764.806425:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444073216:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 299us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219764.806431:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00010000:00010000:0.0:1785219764.807935:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219764.807953:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.807966:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81400 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219764.807971:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.807982:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219764.807989:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219764.808018:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1785219764.808087:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808094:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219764.808141:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808150:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f81400/0x8b38d407a078c60b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c612 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808178:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219764.808180:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219764.808182:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219764.808226:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219764.808251:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465072512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785219764.808308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219764.808433:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465072512 00000100:00100000:0.0:1785219764.808445:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465072512 00010000:00010000:0.0:1785219764.808484:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c60b expref: 17 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219764.808525:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785219764.808535:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:3307:x1871938465072512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785219764.808551:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219764.808557:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c60b expref: 17 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808570:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c60b expref: 17 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808586:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81600/0x8b38d407a078c612 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c60b expref: 17 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808614:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808624:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808643:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808650:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808658:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808664:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808670:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219764.808675:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808691:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808710:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808718:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.808752:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219764.808766:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5780:1871938465072640:192.168.203.31@tcp:105: 00000100:00100000:0.0:1785219764.808933:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf381703540 going to sleep for 11 seconds 00010000:00010000:3.0:1785219764.810698:0:8356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219764.810715:0:8356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219764.825196:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5780:1871938465072640:192.168.203.31@tcp:105: 00010000:00010000:0.0:1785219764.825230:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.825243:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c7cb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219764.825260:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219764.825314:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3307:x1871938465072512:12345-0@lo:103:ldlm_bl.0 Request processed in 16779us (17004us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219764.825325:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785219764.825416:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465072512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219764.833474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219764.835833:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073344 00000100:00100000:3.0:1785219764.835852:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073344 00000100:00100000:3.0:1785219764.835931:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:3.0:1785219764.835941:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444073344:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219764.836326:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444073344:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 386us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219764.836334:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1785219764.846564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219764.846711:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073472 00000100:00100000:3.0:1785219764.846721:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073472 00000100:00100000:3.0:1785219764.846779:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:3.0:1785219764.846788:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444073472:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219764.847000:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:5576:x1871938444073472:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 212us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219764.847009:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:2.0:1785219764.867346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219764.867472:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073600 00000100:00100000:1.0:1785219764.867482:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073600 00000100:00100000:1.0:1785219764.867536:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:1.0:1785219764.867562:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:6095:x1871938444073600:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785219764.867808:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:6095:x1871938444073600:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 249us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219764.867816:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:3.0:1785219764.876809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219764.877672:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073728 00000100:00100000:0.0:1785219764.877697:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073728 00000100:00100000:0.0:1785219764.878204:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:0.0:1785219764.878222:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:6095:x1871938444073728:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785219764.878713:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:6095:x1871938444073728:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 494us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219764.878799:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00010000:00010000:3.0:1785219765.613170:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785219766.379430:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785219766.379439:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf37e4b1000 from 4 10000000:01000000:2.0:1785219766.379444:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785219766.379494:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219766.379505:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219766.379515:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219766.379554:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465072768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785219766.379621:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219766.379682:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6480 going to sleep for 11 seconds 00000100:00100000:1.0:1785219766.379744:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465072768 00000100:00100000:1.0:1785219766.379752:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465072768 00000100:00100000:1.0:1785219766.379804:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1785219766.379813:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465072768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785219766.379827:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219766.379839:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c7d9 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219766.379861:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219766.379872:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219766.379881:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476400, rc 0) 00000100:00100000:1.0:1785219766.379932:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465072768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219766.379939:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1785219766.380203:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465072768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219766.380219:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219766.380228:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219766.380279:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465072896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219766.380303:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219766.380320:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1785219766.382044:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465072896 00000100:00100000:0.0:1785219766.382058:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465072896 00000100:00100000:0.0:1785219766.382111:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1785219766.382136:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465072896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219766.382471:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465072896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219766.382479:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1785219766.382704:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465072896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219766.382757:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219766.382818:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219766.382855:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.383186:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073024 00000100:00100000:3.0:1785219766.383193:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073024 00000100:00100000:3.0:1785219766.383232:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785219766.383240:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465073024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.383414:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465073024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.383422:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1785219766.383439:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219766.383811:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8425:1871938465073152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219766.383852:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.384031:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073152 00000100:00100000:3.0:1785219766.384037:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073152 00000100:00100000:3.0:1785219766.384065:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1785219766.384071:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8425:x1871938465073152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219766.384218:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8425:x1871938465073152:12345-0@lo:502:llog_process_th.0 Request processed in 146us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.384236:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1785219766.384473:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1785219766.384491:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8425:1871938465073152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785219766.384516:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785219766.384530:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219766.384532:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1785219766.384539:0:8425:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf37e4b1000 00000020:00000080:2.0:1785219766.384541:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1785219766.384619:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8425:1871938465073280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219766.384656:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219766.384692:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1785219766.385810:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073280 00000100:00100000:1.0:1785219766.385823:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073280 00000100:00100000:1.0:1785219766.385876:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1785219766.385886:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8425:x1871938465073280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219766.386265:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:8425:x1871938465073280:12345-0@lo:502:llog_process_th.0 Request processed in 379us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219766.386278:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1785219766.386958:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8425:1871938465073280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785219766.386994:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219766.387002:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219766.387005:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1785219766.387011:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1785219766.391399:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1785219766.391438:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219766.391450:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.391464:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219766.391475:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785219766.391478:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf349c7c000 from 4 10000000:01000000:3.0:1785219766.391481:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785219766.391529:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.391537:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.391548:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219766.391576:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.391643:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.391692:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35061d900 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.391712:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073408 00000100:00100000:3.0:1785219766.391720:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073408 00000100:00100000:3.0:1785219766.391771:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1785219766.391780:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465073408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219766.391794:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219766.391813:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c7e7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.391837:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.391847:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.391855:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06000, rc 0) 00000100:00100000:3.0:1785219766.392567:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465073408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 785us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.392575:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1785219766.392890:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219766.392909:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219766.392920:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219766.392982:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219766.393030:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219766.393071:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.393479:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073536 00000100:00100000:3.0:1785219766.393486:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073536 00000100:00100000:3.0:1785219766.393523:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1785219766.393532:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465073536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.396261:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465073536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2722us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.396275:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1785219766.396470:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.396527:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.396572:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.396603:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342f7c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.396619:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073664 00000100:00100000:3.0:1785219766.396625:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073664 00000100:00100000:3.0:1785219766.396661:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1785219766.396682:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465073664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.398565:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465073664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1888us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.398578:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1785219766.398652:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465073664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219766.400963:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8428:1871938465073792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219766.401152:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219766.401241:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf245999f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.408861:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073792 00000100:00100000:3.0:1785219766.408886:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073792 00000100:00100000:3.0:1785219766.408938:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1785219766.408948:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:8428:x1871938465073792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219766.409210:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:8428:x1871938465073792:12345-0@lo:502:llog_process_th.0 Request processed in 263us (8159us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.409217:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1785219766.414035:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8428:1871938465073792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785219766.414084:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219766.414094:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219766.414096:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1785219766.414105:0:8428:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf349c7c000 00000020:00000080:1.0:1785219766.414108:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1785219766.414507:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8428:1871938465073920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219766.414581:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219766.414629:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371b10a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785219766.416449:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465073920 00000100:00100000:2.0:1785219766.416462:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465073920 00000100:00100000:2.0:1785219766.416510:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1785219766.416518:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:8428:x1871938465073920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219766.416764:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:8428:x1871938465073920:12345-0@lo:502:llog_process_th.0 Request processed in 246us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219766.416779:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1785219766.416836:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8428:1871938465073920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785219766.416863:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219766.416870:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219766.416872:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1785219766.419395:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1785219766.420667:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1785219766.420704:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785219766.420716:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219766.420729:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219766.420739:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785219766.420741:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf3503a5000 from 4 10000000:01000000:0.0:1785219766.420744:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785219766.420781:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219766.420788:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219766.420799:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219766.420823:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465074048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785219766.420968:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219766.421091:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2459999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.421143:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074048 00000100:00100000:3.0:1785219766.421151:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074048 00000100:00100000:3.0:1785219766.421203:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1785219766.421213:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465074048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219766.421227:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219766.421240:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c7f5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.421265:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.421276:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.421285:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07c00, rc 0) 00000100:00100000:3.0:1785219766.421338:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465074048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.421350:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1785219766.421418:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465074048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219766.421433:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219766.421442:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219766.421494:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465074176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.421520:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.421535:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705840 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.421547:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074176 00000100:00100000:3.0:1785219766.421550:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074176 00000100:00100000:3.0:1785219766.421571:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1785219766.421577:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465074176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.421825:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465074176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.421832:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1785219766.421863:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465074176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.422121:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465074304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.422160:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.422175:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705840 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.422188:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074304 00000100:00100000:3.0:1785219766.422191:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074304 00000100:00100000:3.0:1785219766.422211:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1785219766.422224:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465074304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.422432:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465074304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.422439:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1785219766.422475:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465074304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219766.422659:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8431:1871938465074432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219766.422709:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.422726:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074432 00000100:00100000:3.0:1785219766.422730:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074432 00000100:00100000:3.0:1785219766.422750:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1785219766.422755:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:8431:x1871938465074432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219766.422867:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:8431:x1871938465074432:12345-0@lo:502:llog_process_th.0 Request processed in 112us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.422873:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1785219766.423112:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219766.423127:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8431:1871938465074432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219766.423153:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219766.423162:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219766.423165:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1785219766.423173:0:8431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf3503a5000 00000020:00000080:3.0:1785219766.423176:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785219766.423283:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8431:1871938465074560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219766.423316:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.423344:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348bc73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219766.424461:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074560 00000100:00100000:2.0:1785219766.424474:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074560 00000100:00100000:2.0:1785219766.424523:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1785219766.424533:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:8431:x1871938465074560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219766.424779:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:8431:x1871938465074560:12345-0@lo:502:llog_process_th.0 Request processed in 247us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219766.424786:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1785219766.424906:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:8431:1871938465074560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219766.424941:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219766.424949:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219766.424951:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1785219766.424956:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1785219766.425239:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1785219766.425256:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785219766.425266:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219766.425277:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219766.647143:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219766.702770:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219766.702849:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465074688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219766.702933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219766.703259:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074688 00000100:00100000:3.0:1785219766.703268:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074688 00000100:00100000:3.0:1785219766.703343:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785219766.703354:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465074688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785219766.703412:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219766.703461:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465074688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219766.703469:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1785219766.703523:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f0a80 x1871938465074688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219766.703543:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465074688:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785219766.703762:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785219767.659630:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219768.683482:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219769.262548:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465074816:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.262638:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219769.262696:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465075328:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.262736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219769.262766:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785219769.262772:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465074944:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.262795:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219769.262813:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465075456:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.262838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219769.262866:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465075072:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.262899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219769.262918:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785219769.262924:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465075200:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.262944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219769.262975:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074816 00000100:00100000:3.0:1785219769.262983:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074816 00000100:00100000:3.0:1785219769.263034:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1785219769.263045:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465074816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263094:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465074816:12345-0@lo:400:kworker.0 Request processed in 51us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219769.263221:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1785219769.263256:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075328 00000100:00100000:3.0:1785219769.263259:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075328 00000100:00100000:3.0:1785219769.263291:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465074944 00000100:00100000:3.0:1785219769.263294:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465074944 00000100:00100000:3.0:1785219769.263306:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075072 00000100:00100000:3.0:1785219769.263308:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075072 00000100:00100000:3.0:1785219769.263322:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785219769.263328:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465075328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263361:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465075328:12345-0@lo:400:kworker.0 Request processed in 33us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219769.263394:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785219769.263407:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785219769.263413:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465074944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263440:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465074944:12345-0@lo:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219769.263446:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785219769.263464:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785219769.263469:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465075072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263504:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465075072:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219769.263510:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785219769.263531:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075456 00000100:00100000:3.0:1785219769.263535:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075456 00000100:00100000:3.0:1785219769.263559:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075200 00000100:00100000:3.0:1785219769.263562:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075200 00000100:00100000:3.0:1785219769.263579:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785219769.263586:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465075456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263615:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465075456:12345-0@lo:400:kworker.0 Request processed in 30us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219769.263621:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785219769.263633:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785219769.263639:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465075200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263678:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465075200:12345-0@lo:400:kworker.0 Request processed in 39us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219769.263684:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1785219769.263704:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785219769.263708:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785219769.263711:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785219769.263748:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f0700 x1871938465075200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219769.263763:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465075200:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263776:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465075072:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263822:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465074944:0@lo:400:kworker.0 00010000:00080000:3.0:1785219769.263833:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f3b80 x1871938465075456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219769.263841:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465075456:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263849:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465074816:0@lo:400:kworker.0 00000100:00100000:3.0:1785219769.263857:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465075328:0@lo:400:kworker.0 00000100:00100000:2.0:1785219769.366259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219769.366308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219769.366347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219769.366399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219769.366429:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073984 00000100:00100000:2.0:1785219769.366452:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073984 00000100:00100000:2.0:1785219769.366523:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1785219769.366534:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444073984:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219769.366610:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444073984:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219769.366618:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1785219769.366643:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444074112 00000100:00100000:2.0:1785219769.366647:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444074112 00000100:00100000:2.0:1785219769.366686:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444074240 00000100:00100000:2.0:1785219769.366689:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444074240 00000100:00100000:2.0:1785219769.366706:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1785219769.366712:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444074112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219769.366742:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444074112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219769.366748:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1785219769.366758:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1785219769.366763:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444074240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219769.366782:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444074240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 20us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219769.366787:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00080000:2.0:1785219769.366800:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219769.366804:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785219769.366806:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219769.366869:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444073856 00000100:00100000:0.0:1785219769.366875:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444073856 00000100:00100000:0.0:1785219769.366913:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1785219769.366924:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444073856:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219769.366969:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444073856:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 46us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219769.366976:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00010000:00010000:1.0:1785219769.707567:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219769.772489:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219769.772512:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465075584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219769.772582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219769.772662:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075584 00000100:00100000:3.0:1785219769.772669:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075584 00000100:00100000:3.0:1785219769.772713:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785219769.772721:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465075584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219769.772757:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219769.772799:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465075584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219769.772806:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1785219769.772846:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f1f80 x1871938465075584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219769.772863:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465075584:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1785219770.715728:0:8655:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1785219770.735202:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219771.757685:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219771.823130:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785219771.823204:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219771.823271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219771.823344:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075712 00000100:00100000:0.0:1785219771.823353:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075712 00000100:00100000:0.0:1785219771.823428:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785219771.823438:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465075712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785219771.823472:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219771.823516:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465075712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219771.823524:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1785219771.823684:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785219771.823719:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc31880 x1871938465075712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219771.823736:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465075712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785219772.779758:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219773.805605:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219774.381601:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465075840:0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.381634:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465076096:0@lo:400:kworker.0 00000100:00100000:2.0:1785219774.381902:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465075968:0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.385989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219774.386085:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785219774.386098:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465076224:0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.386147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219774.386194:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076096 00000100:00100000:0.0:1785219774.386203:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076096 00000100:00100000:0.0:1785219774.386261:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785219774.386270:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465076096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.386328:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465076096:12345-0@lo:400:kworker.0 Request processed in 59us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219774.386335:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785219774.386359:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076224 00000100:00100000:0.0:1785219774.387857:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076224 00000100:00100000:0.0:1785219774.387916:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785219774.387925:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465076224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.387994:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465076224:12345-0@lo:400:kworker.0 Request processed in 71us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219774.388001:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1785219774.388023:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219774.388028:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785219774.388065:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f0380 x1871938465076224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219774.388081:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465076224:0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.388093:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465076096:0@lo:400:kworker.0 00000100:00100000:3.0:1785219774.392261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219774.392333:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465076352:0@lo:400:kworker.0 00000100:00100000:3.0:1785219774.392417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219774.392486:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076352 00000100:00100000:3.0:1785219774.392495:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076352 00000100:00100000:3.0:1785219774.392560:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1785219774.392570:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465076352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219774.392634:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465076352:12345-0@lo:400:kworker.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219774.392642:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1785219774.392688:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465076352:0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.393630:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075840 00000100:00100000:0.0:1785219774.393639:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075840 00000100:00100000:0.0:1785219774.393760:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1785219774.393768:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465075840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.393830:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465075840:12345-0@lo:400:kworker.0 Request processed in 63us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219774.393837:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1785219774.393849:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465075840:0@lo:400:kworker.0 00000100:00080000:0.0:1785219774.393869:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219774.397928:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219774.397987:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465076480:0@lo:400:kworker.0 00000100:00100000:0.0:1785219774.398022:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219774.398065:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465075968 00000100:00100000:3.0:1785219774.398075:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465075968 00000100:00100000:3.0:1785219774.398127:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785219774.398136:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465075968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219774.398200:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465075968:12345-0@lo:400:kworker.0 Request processed in 58us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219774.398207:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785219774.398252:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465075968:0@lo:400:kworker.0 00000100:00100000:2.0:1785219774.398325:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076480 00000100:00100000:2.0:1785219774.398329:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076480 00000100:00100000:2.0:1785219774.398389:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785219774.398396:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465076480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219774.398433:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465076480:12345-0@lo:400:kworker.0 Request processed in 38us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219774.398439:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1785219774.398501:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1785219774.398524:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f2a00 x1871938465076480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219774.398546:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465076480:0@lo:400:kworker.0 00000100:00100000:2.0:1785219774.487815:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219774.487865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219774.487901:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444074496 00000100:00100000:2.0:1785219774.487912:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444074496 00000100:00100000:2.0:1785219774.487967:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1785219774.487976:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444074496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219774.488048:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444074496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219774.488055:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00080000:2.0:1785219774.488074:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219774.488765:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444074368 00000100:00100000:1.0:1785219774.488772:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444074368 00000100:00100000:1.0:1785219774.488817:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:1.0:1785219774.488825:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444074368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219774.488867:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444074368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219774.488874:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:2.0:1785219774.492446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219774.492511:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219774.492541:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444074624 00000100:00100000:2.0:1785219774.492550:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444074624 00000100:00100000:2.0:1785219774.492601:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444074752 00000100:00100000:2.0:1785219774.492605:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444074752 00000100:00100000:2.0:1785219774.492640:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1785219774.492651:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2358:x1871938444074624:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:2.0:1785219774.492695:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c738 00000100:00080000:2.0:1785219774.492720:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9cf2461e9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785219774.492755:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1785219774.493054:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1785219774.493065:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2358:x1871938444074752:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:1.0:1785219774.493082:0:8158:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c73f 00000100:00080000:1.0:1785219774.493088:0:8158:0:(import.c:65:import_set_state_nolock()) ffff9cf348749800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785219774.493110:0:8158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1785219774.493354:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+2:2358:x1871938444074752:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 291us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219774.493386:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00010000:00010000:1.0:1785219774.493407:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219774.493413:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219774.494160:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+2:2358:x1871938444074624:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 1508us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219774.494170:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00080000:2.0:1785219774.494229:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219774.494234:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785219774.830028:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219774.891516:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219774.891539:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465076608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219774.891633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219774.891704:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076608 00000100:00100000:3.0:1785219774.891712:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076608 00000100:00100000:3.0:1785219774.891763:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785219774.891772:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465076608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219774.891807:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219774.891853:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465076608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219774.891860:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1785219774.891921:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f2a00 x1871938465076608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219774.891940:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465076608:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1785219775.361685:0:8899:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing yml_node 00010000:00010000:0.0:1785219775.852586:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219776.875754:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219776.940014:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465076736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219776.940096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219776.940189:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076736 00000100:00100000:1.0:1785219776.940208:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076736 00000100:00100000:1.0:1785219776.940281:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785219776.940292:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465076736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219776.940340:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219776.940422:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465076736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219776.940429:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1785219776.940512:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc31f80 x1871938465076736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219776.940532:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465076736:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785219776.940650:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1785219777.522311:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:0.0:1785219777.522323:0:6614:0:(genops.c:906:class_export_put()) final put ffff9cf2461eb800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:1.0:1785219777.523237:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf2461eb800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb for lustre-OST0000 00000020:00000080:1.0:1785219777.523305:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf2461e9800 for lustre-OST0000 00010000:00010000:0.0:1785219777.899775:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785219778.519961:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:3.0:1785219778.520038:0:7492:0:(genops.c:906:class_export_put()) final put ffff9cf34874e000/3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:1.0:1785219778.520225:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf34874e000/3c48a627-3c4f-49d5-b2ec-dae54c1457bb for lustre-OST0001 00000020:00000080:1.0:1785219778.520276:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf348749800 for lustre-OST0001 00010000:00010000:3.0:1785219778.926861:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219779.500742:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465076864:0@lo:400:kworker.0 00000100:00100000:3.0:1785219779.500768:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465076992:0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.500841:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219779.500869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219779.500915:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465077504:0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.500936:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465077376:0@lo:400:kworker.0 00000100:00100000:3.0:1785219779.500951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219779.500993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219779.501021:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465077248:0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.501051:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465077120:0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.501079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219779.501134:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076864 00000100:00100000:2.0:1785219779.501144:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076864 00000100:00100000:2.0:1785219779.501199:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1785219779.501209:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.501263:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465076864:12345-0@lo:400:kworker.0 Request processed in 55us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219779.501271:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1785219779.501310:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465076992 00000100:00100000:2.0:1785219779.501316:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465076992 00000100:00100000:3.0:1785219779.501337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219779.501386:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465077376 00000100:00100000:2.0:1785219779.501392:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465077376 00000100:00100000:2.0:1785219779.501428:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465077120 00000100:00100000:2.0:1785219779.501432:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465077120 00000100:00100000:2.0:1785219779.501479:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785219779.501487:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465076992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219779.501490:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1785219779.501543:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465076992:12345-0@lo:400:kworker.0 Request processed in 56us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219779.501551:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785219779.501566:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785219779.501599:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465077376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.501600:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465077120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219779.504190:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465077504 00000100:00100000:0.0:1785219779.504210:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465077504 00000100:00100000:0.0:1785219779.504284:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465077248 00000100:00100000:0.0:1785219779.504288:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465077248 00000100:00100000:0.0:1785219779.504408:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785219779.504421:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465077504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219779.505557:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465077376:12345-0@lo:400:kworker.0 Request processed in 3979us (4557us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219779.505574:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785219779.505613:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465077504:12345-0@lo:400:kworker.0 Request processed in 1186us (4653us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219779.505630:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785219779.505658:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785219779.505696:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465077120:12345-0@lo:400:kworker.0 Request processed in 4121us (4612us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219779.505706:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1785219779.505743:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785219779.505751:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219779.505755:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219779.505759:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465077248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.505814:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465077120:0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.505978:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465076992:0@lo:400:kworker.0 00000100:00100000:3.0:1785219779.506005:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465077248:12345-0@lo:400:kworker.0 Request processed in 252us (4666us total) trans 0 rc 0/0 00010000:00080000:2.0:1785219779.506005:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c5500 x1871938465077504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219779.506019:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465077504:0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.506055:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465077376:0@lo:400:kworker.0 00000100:00100000:2.0:1785219779.506065:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465076864:0@lo:400:kworker.0 00000100:00100000:3.0:1785219779.506137:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1785219779.506138:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f1500 x1871938465077248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219779.506154:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465077248:0@lo:400:kworker.0 00000100:00100000:3.0:1785219779.601270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219779.601324:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219779.601351:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444074880 00000100:00100000:0.0:1785219779.601455:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444074880 00000100:00100000:0.0:1785219779.601506:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:0.0:1785219779.601518:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444074880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219779.601609:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444074880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219779.601618:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:1.0:1785219779.601887:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075008 00000100:00100000:1.0:1785219779.601893:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075008 00000100:00100000:1.0:1785219779.601949:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1785219779.601957:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444075008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219779.602007:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444075008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 51us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219779.602015:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00080000:3.0:1785219779.603842:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1785219779.612769:0:9092:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.204 00010000:00010000:0.0:1785219779.948107:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219780.015205:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465077632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219780.015281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219780.015625:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465077632 00000100:00100000:3.0:1785219780.015634:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465077632 00000100:00100000:3.0:1785219780.015704:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785219780.015714:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465077632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219780.015750:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219780.015799:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465077632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219780.015807:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1785219780.016067:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f2680 x1871938465077632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219780.016097:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465077632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785219780.971668:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785219781.566124:0:9190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.204 00010000:00010000:1.0:1785219781.996510:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219782.061281:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465077760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219782.061360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219782.061582:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465077760 00000100:00100000:3.0:1785219782.061592:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465077760 00000100:00100000:3.0:1785219782.061662:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785219782.061672:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465077760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785219782.061709:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219782.061766:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465077760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219782.061773:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1785219782.061798:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f2680 x1871938465077760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219782.061817:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465077760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785219782.061820:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785219783.021737:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785219783.401152:0:9287:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.204 00010000:00010000:1.0:1785219784.044076:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219784.621254:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785219784.622821:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465078016:0@lo:400:kworker.0 00000100:00100000:1.0:1785219784.622911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219784.622988:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465077888:0@lo:400:kworker.0 00000100:00100000:1.0:1785219784.623021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219784.623653:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078016 00000100:00100000:3.0:1785219784.623665:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078016 00000100:00100000:3.0:1785219784.623736:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785219784.623748:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465078016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219784.623822:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465078016:12345-0@lo:400:kworker.0 Request processed in 77us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219784.623830:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785219784.623864:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465077888 00000100:00100000:3.0:1785219784.623868:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465077888 00000100:00100000:3.0:1785219784.623895:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1785219784.623901:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465077888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219784.623934:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465077888:12345-0@lo:400:kworker.0 Request processed in 33us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219784.623940:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1785219784.625003:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465077888:0@lo:400:kworker.0 00000100:00100000:1.0:1785219784.625193:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465078016:0@lo:400:kworker.0 00000100:00100000:2.0:1785219784.629761:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465078144:0@lo:400:kworker.0 00000100:00100000:2.0:1785219784.629869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219784.629983:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219784.629989:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465078272:0@lo:400:kworker.0 00000100:00100000:2.0:1785219784.630015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219784.630053:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078272 00000100:00100000:2.0:1785219784.630061:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078272 00000100:00100000:2.0:1785219784.630128:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785219784.630138:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465078272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219784.630195:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465078272:12345-0@lo:400:kworker.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219784.630203:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1785219784.630224:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785219784.630255:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf247278a80 x1871938465078272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219784.630271:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465078272:0@lo:400:kworker.0 00000100:00100000:2.0:1785219784.630297:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465078400:0@lo:400:kworker.0 00000100:00100000:2.0:1785219784.630323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219784.630341:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219784.630347:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465078528:0@lo:400:kworker.0 00000100:00100000:2.0:1785219784.630408:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219784.632041:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078144 00000100:00100000:1.0:1785219784.632061:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078144 00000100:00100000:1.0:1785219784.632142:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078400 00000100:00100000:1.0:1785219784.632146:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078400 00000100:00100000:1.0:1785219784.632173:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785219784.632182:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465078144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219784.632287:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465078144:12345-0@lo:400:kworker.0 Request processed in 104us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219784.632294:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785219784.632314:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785219784.632321:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465078400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219784.632359:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465078400:12345-0@lo:400:kworker.0 Request processed in 39us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219784.632385:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785219784.632435:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465078144:0@lo:400:kworker.0 00000100:00100000:1.0:1785219784.632478:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465078400:0@lo:400:kworker.0 00000100:00080000:3.0:1785219784.632577:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219784.632667:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078528 00000100:00100000:0.0:1785219784.632672:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078528 00000100:00100000:0.0:1785219784.632727:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785219784.632735:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219784.632784:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465078528:12345-0@lo:400:kworker.0 Request processed in 50us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219784.632790:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1785219784.632821:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf247278380 x1871938465078528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219784.632833:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465078528:0@lo:400:kworker.0 00000100:00080000:3.0:1785219784.633069:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785219784.721480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219784.721971:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075136 00000100:00100000:2.0:1785219784.721983:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075136 00000100:00100000:2.0:1785219784.722052:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:2.0:1785219784.722063:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444075136:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219784.722161:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444075136:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 100us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219784.722178:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:3.0:1785219784.729654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219784.729720:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075264 00000100:00100000:1.0:1785219784.729739:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075264 00000100:00080000:3.0:1785219784.729828:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219784.729834:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1785219784.729846:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444075264:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219784.729941:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444075264:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219784.729950:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000001:02000400:1.0:1785219784.815139:0:9336:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jul 28 02:23:02 EDT 2026 00010000:00010000:3.0:1785219785.067672:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219785.131642:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219785.131676:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465078656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219785.131777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219785.141356:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078656 00000100:00100000:0.0:1785219785.141406:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078656 00000100:00100000:0.0:1785219785.141478:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785219785.141491:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465078656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785219785.141551:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219785.141645:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465078656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (9874us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219785.141653:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1785219785.142226:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f0000 x1871938465078656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219785.142248:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465078656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785219786.093511:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219787.115789:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219787.182120:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465078784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219787.182203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219787.184810:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078784 00000100:00100000:1.0:1785219787.184825:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078784 00000100:00100000:1.0:1785219787.185154:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785219787.185165:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465078784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219787.185205:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219787.185294:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465078784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219787.185302:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1785219787.185354:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f0000 x1871938465078784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219787.185408:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465078784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785219787.185802:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785219788.140914:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219789.163582:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219789.741091:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465078912:0@lo:400:kworker.0 00000100:00100000:0.0:1785219789.741186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219789.741227:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465079168:0@lo:400:kworker.0 00000100:00100000:0.0:1785219789.741251:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465079424:0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.741935:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465079040:0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.741990:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465079296:0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.742023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219789.742096:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079296 00000100:00100000:1.0:1785219789.742105:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079296 00000100:00100000:1.0:1785219789.742184:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785219789.742194:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465079296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.742256:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465079296:12345-0@lo:400:kworker.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219789.742264:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1785219789.742286:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785219789.742319:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc30a80 x1871938465079296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219789.742335:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465079296:0@lo:400:kworker.0 00000100:00100000:3.0:1785219789.743544:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465078912 00000100:00100000:3.0:1785219789.743630:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465078912 00000100:00100000:3.0:1785219789.743889:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1785219789.743903:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465078912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219789.743986:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465078912:12345-0@lo:400:kworker.0 Request processed in 87us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219789.743995:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1785219789.745931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219789.746027:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079424 00000100:00100000:3.0:1785219789.746041:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079424 00000100:00100000:0.0:1785219789.746070:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465078912:0@lo:400:kworker.0 00000100:00100000:3.0:1785219789.746123:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785219789.746139:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465079424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219789.746154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219789.746236:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465079424:12345-0@lo:400:kworker.0 Request processed in 100us (4340us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219789.746260:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465079424:0@lo:400:kworker.0 00000100:00100000:3.0:1785219789.746271:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785219789.746298:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079168 00000100:00100000:3.0:1785219789.746303:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079168 00000100:00100000:3.0:1785219789.746336:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785219789.746346:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465079168:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785219789.746396:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219789.746420:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219789.746434:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465079168:12345-0@lo:400:kworker.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219789.746442:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785219789.746461:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079040 00000100:00100000:3.0:1785219789.746464:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079040 00000100:00100000:1.0:1785219789.746469:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465079552:0@lo:400:kworker.0 00000100:00100000:3.0:1785219789.746496:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785219789.746505:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465079040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.746542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219789.746632:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465079168:0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.748823:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465079040:0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.749029:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079552 00000100:00100000:1.0:1785219789.749037:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079552 00000100:00100000:1.0:1785219789.749114:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785219789.749124:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465079552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219789.749293:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465079552:12345-0@lo:400:kworker.0 Request processed in 169us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219789.749301:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1785219789.749349:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc31f80 x1871938465079552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219789.749385:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465079552:0@lo:400:kworker.0 00000100:00080000:0.0:1785219789.749480:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785219789.751787:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465079040:12345-0@lo:400:kworker.0 Request processed in 5271us (5356us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219789.751803:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785219789.840599:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219789.840652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219789.841232:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075392 00000100:00100000:0.0:1785219789.841253:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075392 00000100:00100000:0.0:1785219789.841349:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1785219789.841403:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444075392:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219789.841528:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2361:x1871938444075392:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 167us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219789.841555:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:1.0:1785219789.841728:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075520 00000100:00100000:1.0:1785219789.841742:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075520 00000100:00100000:1.0:1785219789.841818:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1785219789.841826:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444075520:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219789.841880:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444075520:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 55us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219789.841887:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00080000:0.0:1785219789.841953:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785219790.187557:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219790.253304:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785219790.253419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219790.253535:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079680 00000100:00100000:1.0:1785219790.253545:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079680 00000100:00100000:1.0:1785219790.253615:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785219790.253625:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465079680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219790.253673:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219790.253954:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465079680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 328us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219790.253962:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1785219790.255039:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f0380 x1871938465079680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219790.255069:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465079680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785219791.214477:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219792.235825:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219792.300697:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465079808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219792.300793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219792.301031:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079808 00000100:00100000:3.0:1785219792.301042:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079808 00000100:00100000:3.0:1785219792.301121:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785219792.301133:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465079808:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785219792.301160:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1785219792.301179:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219792.301248:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465079808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219792.301256:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1785219792.301315:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f0700 x1871938465079808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219792.301339:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465079808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785219793.259754:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219794.290038:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219794.860757:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465079936:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.860782:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465080320:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.860833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219794.860834:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219794.862768:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219794.862786:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465080192:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.862844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219794.862913:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465080448:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.862926:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080192 00000100:00100000:3.0:1785219794.862935:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080192 00000100:00100000:0.0:1785219794.862949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219794.862978:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785219794.862986:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465080064:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.862992:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080448 00000100:00100000:3.0:1785219794.862997:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080448 00000100:00100000:0.0:1785219794.863014:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219794.863021:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080064 00000100:00100000:3.0:1785219794.863025:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080064 00000100:00100000:0.0:1785219794.863031:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465080576:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.863045:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1785219794.863054:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465080192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219794.863061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785219794.863091:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219794.863108:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785219794.863115:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465080192:12345-0@lo:400:kworker.0 Request processed in 61us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219794.863120:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465080448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.863129:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1785219794.863149:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1785219794.863158:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465080064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219794.863164:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465080448:12345-0@lo:400:kworker.0 Request processed in 46us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219794.863172:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785219794.863195:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465080064:12345-0@lo:400:kworker.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219794.863202:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785219794.863217:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465080064:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.863225:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465079936 00000100:00100000:3.0:1785219794.863230:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465079936 00000100:00100000:0.0:1785219794.863254:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465080448:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.863259:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1785219794.863268:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465079936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.863317:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465079936:12345-0@lo:400:kworker.0 Request processed in 50us (2486us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219794.863330:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1785219794.863337:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465079936:0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.863383:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080320 00000100:00100000:3.0:1785219794.863388:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080320 00000100:00080000:0.0:1785219794.863409:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219794.863420:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080576 00000100:00100000:3.0:1785219794.863424:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080576 00000100:00100000:3.0:1785219794.863455:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785219794.863461:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465080320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785219794.863504:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785219794.863507:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465080320:12345-0@lo:400:kworker.0 Request processed in 45us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219794.863514:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785219794.863526:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785219794.863531:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465080576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219794.863568:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465080576:12345-0@lo:400:kworker.0 Request processed in 36us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219794.863574:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785219794.863602:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465080192:0@lo:400:kworker.0 00010000:00080000:3.0:1785219794.863719:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cef0e00 x1871938465080320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219794.863730:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465080320:0@lo:400:kworker.0 00010000:00080000:0.0:1785219794.864050:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cef3100 x1871938465080576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219794.864061:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465080576:0@lo:400:kworker.0 00000100:00100000:2.0:1785219794.963108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219794.963148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219794.963434:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075648 00000100:00100000:1.0:1785219794.963518:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075648 00000100:00100000:1.0:1785219794.963574:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:1.0:1785219794.963586:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2359:x1871938444075648:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219794.963742:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2359:x1871938444075648:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 158us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219794.963752:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:0.0:1785219794.966418:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075776 00000100:00100000:0.0:1785219794.966434:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075776 00000100:00100000:0.0:1785219794.966529:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:0.0:1785219794.966540:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2359:x1871938444075776:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219794.966640:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2359:x1871938444075776:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 92us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219794.966649:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00080000:1.0:1785219794.966693:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785219795.307838:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219795.374868:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219795.374892:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465080704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219795.374958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219795.375023:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080704 00000100:00100000:3.0:1785219795.375031:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080704 00000100:00100000:3.0:1785219795.375099:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785219795.375107:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465080704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219795.375142:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219795.375199:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465080704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219795.375206:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1785219795.375248:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f1880 x1871938465080704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219795.375265:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465080704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785219796.332796:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219797.360276:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219797.421261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219797.421292:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465080832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219797.421431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219797.421662:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080832 00000100:00100000:3.0:1785219797.421673:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080832 00000100:00100000:3.0:1785219797.421757:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785219797.421768:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465080832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785219797.421823:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219797.421883:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465080832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219797.421890:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1785219797.421944:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f1880 x1871938465080832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219797.421966:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465080832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785219797.422100:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785219798.380209:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219799.405030:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785219799.458001:0:9966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:23:17 (1785219797) === 00000100:00100000:2.0:1785219799.824516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219799.825793:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444075904 00000100:00100000:3.0:1785219799.825810:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444075904 00000100:00100000:3.0:1785219799.825897:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:3.0:1785219799.825909:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:8132:x1871938444075904:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1785219799.825953:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219799.825978:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f25f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219799.826020:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f25f expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219799.826034:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f25f expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219799.826045:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07a00, rc 0) 00000100:00100000:3.0:1785219799.826312:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8132:x1871938444075904:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 403us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219799.826320:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:0.0:1785219799.844219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219799.844310:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076032 00000100:00100000:1.0:1785219799.844323:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076032 00000100:00100000:1.0:1785219799.844419:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:1.0:1785219799.844429:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8132:x1871938444076032:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1785219799.844927:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8132:x1871938444076032:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 495us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.844937:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:2.0:1785219799.851574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219799.851712:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076160 00000100:00100000:1.0:1785219799.851726:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076160 00000100:00100000:1.0:1785219799.851840:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:1.0:1785219799.851852:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8132:x1871938444076160:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1785219799.852148:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8132:x1871938444076160:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 298us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.852158:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:2.0:1785219799.863686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219799.864144:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076288 00000100:00100000:1.0:1785219799.864156:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076288 00000100:00100000:1.0:1785219799.864233:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:1.0:1785219799.864245:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8136:x1871938444076288:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785219799.865077:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8136:x1871938444076288:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 829us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219799.865088:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:0.0:1785219799.885566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219799.885699:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076416 00000100:00100000:1.0:1785219799.885712:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076416 00000100:00100000:1.0:1785219799.885797:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:1.0:1785219799.885808:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8136:x1871938444076416:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785219799.886177:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8136:x1871938444076416:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 368us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.886197:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:2.0:1785219799.898219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219799.899696:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076544 00000100:00100000:0.0:1785219799.899715:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076544 00000100:00100000:0.0:1785219799.899803:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:0.0:1785219799.899815:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:8132:x1871938444076544:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785219799.899857:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219799.899882:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cc000/0x8b38d407a078c80a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f289 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219799.899922:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cc000/0x8b38d407a078c80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f289 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219799.899936:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cc000/0x8b38d407a078c80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f289 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219799.899957:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cc000, rc 0) 00000100:00100000:0.0:1785219799.900041:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:8132:x1871938444076544:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 229us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219799.900049:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:2.0:1785219799.911587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219799.911808:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076672 00000100:00100000:3.0:1785219799.911823:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076672 00000100:00100000:3.0:1785219799.911891:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:3.0:1785219799.911903:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:8132:x1871938444076672:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1785219799.911939:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1785219799.911970:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1785219799.911975:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1785219799.911978:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1785219799.911980:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1785219799.917273:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:8132:x1871938444076672:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 5356us (5684us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219799.917292:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:2.0:1785219799.924042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219799.924185:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076800 00000100:00100000:0.0:1785219799.924198:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076800 00000100:00100000:0.0:1785219799.924273:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:0.0:1785219799.924286:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:8132:x1871938444076800:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785219799.924310:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219799.924335:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f290 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219799.924422:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219799.924469:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219799.924482:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cc600, rc 0) 00000100:00100000:0.0:1785219799.924567:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8132:x1871938444076800:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 283us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219799.924574:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1785219799.927173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219799.927828:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444076928 00000100:00100000:0.0:1785219799.927842:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444076928 00000100:00100000:0.0:1785219799.927918:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:0.0:1785219799.927931:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8132:x1871938444076928:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785219799.930676:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8132:x1871938444076928:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 2731us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219799.930693:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:3.0:1785219799.941660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219799.941798:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077056 00000100:00100000:1.0:1785219799.941811:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077056 00000100:00100000:1.0:1785219799.941883:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:1.0:1785219799.941894:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8132:x1871938444077056:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1785219799.942201:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8132:x1871938444077056:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 308us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.942210:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:2.0:1785219799.960857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219799.964209:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077184 00000100:00100000:0.0:1785219799.964232:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077184 00000100:00100000:0.0:1785219799.964311:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1785219799.964323:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8141:x1871938444077184:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785219799.965709:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8141:x1871938444077184:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 1378us (4857us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219799.965723:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:2.0:1785219799.972579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219799.972674:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077312 00000100:00100000:3.0:1785219799.972684:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077312 00000100:00100000:3.0:1785219799.972751:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:3.0:1785219799.972761:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8141:x1871938444077312:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785219799.973274:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:8141:x1871938444077312:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 512us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219799.973283:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:1.0:1785219799.982047:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465081088:0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.982127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219799.982184:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465081600:0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.982211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219799.982257:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785219799.982263:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465080960:0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.982291:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219799.982315:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465081472:0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.982336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219799.982385:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081088 00000100:00100000:1.0:1785219799.982393:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081088 00000100:00100000:1.0:1785219799.982458:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081472 00000100:00100000:1.0:1785219799.982462:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081472 00000100:00100000:1.0:1785219799.982492:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785219799.982501:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465081088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.982551:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465081088:12345-0@lo:400:kworker.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.982574:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785219799.982591:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785219799.983098:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465081472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.983136:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465081472:12345-0@lo:400:kworker.0 Request processed in 539us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.983143:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1785219799.983170:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219799.983207:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465081472:0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.983421:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465081088:0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.983467:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465080960 00000100:00100000:1.0:1785219799.983472:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465080960 00000100:00100000:1.0:1785219799.983502:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1785219799.983510:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.983553:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465080960:12345-0@lo:400:kworker.0 Request processed in 43us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.983558:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1785219799.983593:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465080960:0@lo:400:kworker.0 00000100:00100000:3.0:1785219799.984486:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465081216:0@lo:400:kworker.0 00000100:00100000:3.0:1785219799.984534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219799.984584:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785219799.984592:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465081344:0@lo:400:kworker.0 00000100:00100000:3.0:1785219799.984631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219799.984663:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081600 00000100:00100000:3.0:1785219799.984670:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081600 00000100:00100000:3.0:1785219799.984718:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081344 00000100:00100000:3.0:1785219799.984721:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081344 00000100:00100000:3.0:1785219799.984740:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785219799.984746:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465081600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219799.984801:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465081600:12345-0@lo:400:kworker.0 Request processed in 54us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219799.984807:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785219799.984820:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785219799.984825:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465081344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219799.984849:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465081344:12345-0@lo:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219799.984854:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1785219799.984875:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785219799.984878:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1785219799.984899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf247278380 x1871938465081344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219799.984928:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465081344:0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.985942:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081216 00000100:00100000:1.0:1785219799.985954:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081216 00000100:00100000:1.0:1785219799.986019:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785219799.986026:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465081216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219799.986092:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465081216:12345-0@lo:400:kworker.0 Request processed in 66us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.986099:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785219799.986155:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465081216:0@lo:400:kworker.0 00010000:00080000:1.0:1785219799.986189:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf24727bb80 x1871938465081600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219799.986199:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465081600:0@lo:400:kworker.0 00000100:00080000:3.0:1785219799.986510:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219799.991477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219799.991751:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077440 00000100:00100000:1.0:1785219799.991763:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077440 00000100:00100000:1.0:1785219799.991816:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1785219799.991825:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1871938444077440:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1785219799.991860:0:5794:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 440d444c-61d3-4ab8-9ade-966ffdd2cbcf@192.168.203.31@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:1.0:1785219799.991901:0:5794:0:(genops.c:1406:class_connect()) connect: client 440d444c-61d3-4ab8-9ade-966ffdd2cbcf, cookie 0x8b38d407a078c818 00000004:00100000:1.0:1785219799.991934:0:5794:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1785219799.992200:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9cf36cda6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219799.994121:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2358:x1871938444077440:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 2288us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219799.994135:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1785219799.999025:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219800.000120:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077824 00000100:00100000:1.0:1785219800.001750:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077824 00000100:00080000:0.0:1785219800.001836:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219800.001867:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1785219800.001880:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444077824:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219800.001980:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444077824:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 102us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219800.001988:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1785219800.002851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219800.003223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219800.003718:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077696 00000100:00100000:2.0:1785219800.003726:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077696 00000100:00100000:2.0:1785219800.003779:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077568 00000100:00100000:2.0:1785219800.003783:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077568 00000100:00080000:0.0:1785219800.003790:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219800.003808:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1785219800.003819:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+7:8132:x1871938444077696:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785219800.003859:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785219800.003941:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+7:8132:x1871938444077696:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 123us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219800.003948:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1785219800.003965:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1785219800.003971:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:0:x1871938444077568:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785219800.003984:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785219800.004007:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:0:x1871938444077568:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 36us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219800.004014:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1785219800.009575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219800.009727:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444077952 00000100:00100000:2.0:1785219800.009738:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444077952 00000100:00100000:2.0:1785219800.009817:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1785219800.009828:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:8132:x1871938444077952:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1785219800.010136:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:8132:x1871938444077952:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 308us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219800.010145:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1785219800.014693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219800.014747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219800.014797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219800.015359:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078336 00000100:00100000:0.0:1785219800.015404:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078336 00000100:00100000:0.0:1785219800.015463:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1785219800.015475:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:8132:x1871938444078336:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1785219800.015739:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1785219800.015923:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:8132:x1871938444078336:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 450us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219800.015932:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1785219800.017023:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078080 00000100:00100000:1.0:1785219800.017033:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078080 00000100:00100000:1.0:1785219800.017066:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078208 00000100:00100000:1.0:1785219800.017080:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078208 00000100:00100000:1.0:1785219800.017108:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1785219800.017115:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1871938444078080:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785219800.017141:0:6586:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 440d444c-61d3-4ab8-9ade-966ffdd2cbcf@192.168.203.31@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:1.0:1785219800.017172:0:6586:0:(genops.c:1406:class_connect()) connect: client 440d444c-61d3-4ab8-9ade-966ffdd2cbcf, cookie 0x8b38d407a078c81f 00002000:00100000:1.0:1785219800.017182:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 440d444c-61d3-4ab8-9ade-966ffdd2cbcf/ffff9cf36cda6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1785219800.017288:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1785219800.017377:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1871938444078208:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1785219800.017395:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 440d444c-61d3-4ab8-9ade-966ffdd2cbcf@192.168.203.31@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:0.0:1785219800.017411:0:6589:0:(genops.c:1406:class_connect()) connect: client 440d444c-61d3-4ab8-9ade-966ffdd2cbcf, cookie 0x8b38d407a078c826 00002000:00100000:0.0:1785219800.017416:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 440d444c-61d3-4ab8-9ade-966ffdd2cbcf/ffff9cf3811b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785219800.017437:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785219800.017644:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785219800.017684:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9cf3811b3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219800.017746:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2358:x1871938444078208:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 384us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219800.017755:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00002000:00100000:1.0:1785219800.017891:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785219800.018027:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1785219800.018043:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9cf36cda4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219800.018086:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2358:x1871938444078080:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 971us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219800.018095:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00010000:00010000:0.0:1785219800.429779:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219800.492072:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219800.492103:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465081728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219800.492196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219800.492843:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081728 00000100:00100000:3.0:1785219800.492857:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081728 00000100:00100000:3.0:1785219800.492934:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785219800.492958:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465081728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219800.492990:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219800.493084:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465081728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219800.493092:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1785219800.493149:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348932d80 x1871938465081728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219800.493190:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465081728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785219801.452902:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219802.480002:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219802.540536:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785219802.540560:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465081856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219802.540630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219802.540695:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081856 00000100:00100000:3.0:1785219802.540703:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081856 00000100:00100000:3.0:1785219802.540768:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785219802.540777:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465081856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785219802.540814:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219802.540859:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465081856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219802.540866:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1785219802.540896:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785219802.540926:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348933480 x1871938465081856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219802.540944:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465081856:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1785219803.107979:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00010000:00010000:0.0:1785219803.499588:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785219804.131521:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00000001:00100000:0.0:1785219804.133316:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00010000:00010000:1.0:1785219804.523925:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219805.100573:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465082240:0@lo:400:kworker.0 00000100:00100000:1.0:1785219805.100637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219805.100689:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219805.100694:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465082368:0@lo:400:kworker.0 00000100:00100000:1.0:1785219805.100715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219805.100743:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465082240 00000100:00100000:1.0:1785219805.100750:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465082240 00000100:00100000:1.0:1785219805.100806:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785219805.100817:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219805.100864:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465082240:12345-0@lo:400:kworker.0 Request processed in 49us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219805.100870:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1785219805.100889:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219805.100930:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465082240:0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.100984:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465082112:0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101011:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219805.101034:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465082624:0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101051:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219805.101067:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785219805.101072:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465081984:0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219805.101110:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465082496:0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101137:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219805.101158:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465082368 00000100:00100000:2.0:1785219805.101162:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465082368 00000100:00100000:2.0:1785219805.101190:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465082624 00000100:00100000:2.0:1785219805.101192:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465082624 00000100:00100000:2.0:1785219805.101208:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785219805.101213:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465082368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101244:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465082368:12345-0@lo:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219805.101250:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785219805.101261:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785219805.101266:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465082624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101289:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465082624:12345-0@lo:400:kworker.0 Request processed in 23us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219805.101294:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785219805.101308:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465081984 00000100:00100000:2.0:1785219805.101310:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465081984 00000100:00100000:2.0:1785219805.101330:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1785219805.101334:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465081984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101356:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465081984:12345-0@lo:400:kworker.0 Request processed in 22us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219805.101384:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1785219805.101417:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465082112 00000100:00100000:2.0:1785219805.101420:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465082112 00000100:00100000:2.0:1785219805.101437:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465082496 00000100:00100000:2.0:1785219805.101440:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465082496 00000100:00100000:2.0:1785219805.101454:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785219805.101460:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465082112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101491:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465082112:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219805.101497:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785219805.101506:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1785219805.101511:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465082496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101529:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465082496:12345-0@lo:400:kworker.0 Request processed in 18us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219805.101534:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1785219805.101555:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785219805.101558:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219805.101560:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219805.101575:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465081984:0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101584:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465082496:0@lo:400:kworker.0 00000100:00100000:2.0:1785219805.101591:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465082112:0@lo:400:kworker.0 00010000:00080000:2.0:1785219805.101603:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc31f80 x1871938465082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219805.101613:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465082624:0@lo:400:kworker.0 00010000:00080000:2.0:1785219805.101636:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37eb07480 x1871938465082368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219805.101644:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465082368:0@lo:400:kworker.0 00000100:00100000:0.0:1785219805.212515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219805.212563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219805.212595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219805.212628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219805.212669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219805.212699:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078848 00000100:00100000:0.0:1785219805.212710:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078848 00000100:00100000:0.0:1785219805.212768:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078976 00000100:00100000:0.0:1785219805.212772:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078976 00000100:00100000:0.0:1785219805.212798:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1785219805.212809:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2361:x1871938444078848:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219805.212891:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2361:x1871938444078848:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219805.212898:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1785219805.212914:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1785219805.212920:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444078976:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219805.212948:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444078976:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219805.212953:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00080000:0.0:1785219805.212982:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785219805.212986:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219805.213174:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078720 00000100:00100000:1.0:1785219805.213179:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078720 00000100:00100000:1.0:1785219805.213218:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078592 00000100:00100000:1.0:1785219805.213221:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078592 00000100:00100000:1.0:1785219805.213244:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1785219805.213251:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444078720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219805.213287:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444078720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219805.213294:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1785219805.213309:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1785219805.213315:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444078592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219805.213337:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444078592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219805.213343:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00080000:0.0:1785219805.213481:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219805.213855:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444078464 00000100:00100000:3.0:1785219805.213862:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444078464 00000100:00100000:3.0:1785219805.213970:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:3.0:1785219805.213978:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444078464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219805.214020:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444078464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219805.214027:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 218 00010000:00010000:0.0:1785219805.549128:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219805.613312:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465082752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219805.613512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219805.613666:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465082752 00000100:00100000:1.0:1785219805.613675:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465082752 00000100:00100000:1.0:1785219805.613728:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785219805.613736:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465082752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219805.613772:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219805.613830:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465082752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219805.613837:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1785219805.613930:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc31500 x1871938465082752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219805.613957:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465082752:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1785219805.702647:0:10162:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1785219806.571584:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219807.599169:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219807.659555:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219807.659590:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465082880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219807.659661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219807.659728:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465082880 00000100:00100000:2.0:1785219807.659735:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465082880 00000100:00100000:2.0:1785219807.659787:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785219807.659797:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465082880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785219807.659833:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219807.659878:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465082880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219807.659885:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1785219807.659906:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785219807.659934:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348933480 x1871938465082880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219807.659952:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465082880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785219808.620657:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219809.643811:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219810.219581:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465083392:0@lo:400:kworker.0 00000100:00100000:1.0:1785219810.219659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219810.219724:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785219810.219730:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465083264:0@lo:400:kworker.0 00000100:00100000:1.0:1785219810.219753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219810.219781:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083392 00000100:00100000:1.0:1785219810.219788:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083392 00000100:00100000:1.0:1785219810.219838:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785219810.219846:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465083392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219810.219892:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465083392:12345-0@lo:400:kworker.0 Request processed in 47us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219810.219899:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785219810.219919:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083264 00000100:00100000:1.0:1785219810.219922:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083264 00000100:00100000:1.0:1785219810.219943:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785219810.219949:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465083264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219810.219976:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465083264:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219810.219981:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785219810.220019:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465083264:0@lo:400:kworker.0 00010000:00080000:1.0:1785219810.220034:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc31f80 x1871938465083392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219810.220044:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465083392:0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220295:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465083008:0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219810.220396:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465083520:0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219810.220438:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785219810.220443:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465083136:0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220461:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219810.220474:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465083648:0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219810.220512:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083520 00000100:00100000:3.0:1785219810.220516:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083520 00000100:00100000:3.0:1785219810.220537:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083136 00000100:00100000:3.0:1785219810.220539:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083136 00000100:00100000:3.0:1785219810.220554:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785219810.220567:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465083520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220600:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465083520:12345-0@lo:400:kworker.0 Request processed in 34us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219810.220606:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785219810.220617:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785219810.220622:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465083136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220656:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465083136:12345-0@lo:400:kworker.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219810.220661:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785219810.220679:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083648 00000100:00100000:3.0:1785219810.220682:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083648 00000100:00100000:3.0:1785219810.220705:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785219810.220711:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465083648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220741:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465083648:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219810.220747:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785219810.220781:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465083136:0@lo:400:kworker.0 00010000:00080000:3.0:1785219810.220791:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37eb06300 x1871938465083648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219810.220801:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465083648:0@lo:400:kworker.0 00000100:00100000:3.0:1785219810.220810:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465083520:0@lo:400:kworker.0 00000100:00080000:2.0:1785219810.220936:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219810.220942:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785219810.220944:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219810.221003:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083008 00000100:00100000:1.0:1785219810.221007:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083008 00000100:00100000:1.0:1785219810.221044:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1785219810.221051:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465083008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219810.221094:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465083008:12345-0@lo:400:kworker.0 Request processed in 44us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219810.221106:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1785219810.221169:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465083008:0@lo:400:kworker.0 00000100:00100000:0.0:1785219810.333960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219810.334001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219810.334036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219810.334061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219810.334147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219810.334186:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444079488 00000100:00100000:0.0:1785219810.334196:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444079488 00000100:00100000:0.0:1785219810.334256:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444079616 00000100:00100000:0.0:1785219810.334259:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444079616 00000100:00100000:0.0:1785219810.334280:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1785219810.334288:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444079488:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219810.334355:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444079488:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 68us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219810.334402:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1785219810.334421:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1785219810.334428:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381563450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444079616:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219810.334455:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381563450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444079616:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219810.334460:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1785219810.334621:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444079104 00000100:00100000:0.0:1785219810.334625:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444079104 00000100:00100000:0.0:1785219810.334662:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1785219810.334668:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444079104:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219810.334695:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444079104:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219810.334700:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1785219810.334724:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444079232 00000100:00100000:0.0:1785219810.334728:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444079232 00000100:00100000:0.0:1785219810.334755:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444079360 00000100:00100000:0.0:1785219810.334758:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444079360 00000100:00100000:3.0:1785219810.335115:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1785219810.335167:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1785219810.343521:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444079232:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219810.343636:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444079232:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 8512us (9684us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219810.343647:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00080000:3.0:1785219810.344610:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785219810.344618:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785219810.344621:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219810.351895:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444079360:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219810.351997:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444079360:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 16822us (17933us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219810.352007:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00010000:00010000:1.0:1785219810.667634:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219810.732336:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219810.732360:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465083776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219810.732465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219810.732580:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083776 00000100:00100000:1.0:1785219810.732589:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083776 00000100:00100000:1.0:1785219810.732643:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785219810.732653:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465083776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219810.732686:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219810.732743:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465083776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219810.732750:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1785219810.732876:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37eb05180 x1871938465083776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219810.732894:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465083776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785219811.694812:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219812.718914:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219812.780930:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219812.780956:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465083904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219812.781042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219812.781299:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465083904 00000100:00100000:3.0:1785219812.781309:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465083904 00000100:00100000:3.0:1785219812.781416:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785219812.781428:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465083904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785219812.781466:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219812.781519:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465083904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219812.781526:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1785219812.781569:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348930000 x1871938465083904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219812.781588:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465083904:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785219812.781687:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785219813.741918:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219814.763617:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219815.342726:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465084032:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.342832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219815.342895:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465084544:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.342930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219815.342975:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785219815.342981:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465084160:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.343004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219815.343030:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465084672:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.343061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219815.343095:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465084288:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.343121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219815.343141:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785219815.343146:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465084416:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.343169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219815.343212:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084032 00000100:00100000:0.0:1785219815.343222:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084032 00000100:00100000:3.0:1785219815.343224:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084672 00000100:00100000:3.0:1785219815.343231:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084672 00000100:00100000:3.0:1785219815.343295:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084416 00000100:00100000:3.0:1785219815.343299:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084416 00000100:00100000:0.0:1785219815.343300:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1785219815.343312:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465084032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219815.343349:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785219815.343361:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465084672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.343415:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465084032:12345-0@lo:400:kworker.0 Request processed in 104us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.343423:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1785219815.343466:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084544 00000100:00100000:0.0:1785219815.343470:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084544 00000100:00100000:0.0:1785219815.343503:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084160 00000100:00100000:0.0:1785219815.343506:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084160 00000100:00100000:0.0:1785219815.343519:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084288 00000100:00100000:0.0:1785219815.343521:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084288 00000100:00100000:0.0:1785219815.343536:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1785219815.343542:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465084544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.343581:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465084544:12345-0@lo:400:kworker.0 Request processed in 38us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.343588:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785219815.343598:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465084672:12345-0@lo:400:kworker.0 Request processed in 239us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.343605:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785219815.343610:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1785219815.343615:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465084160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219815.343630:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785219815.343641:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465084416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.343661:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465084160:12345-0@lo:400:kworker.0 Request processed in 47us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.343667:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785219815.343684:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1785219815.343693:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465084416:12345-0@lo:400:kworker.0 Request processed in 54us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.343694:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465084288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219815.343706:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1785219815.343736:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219815.343739:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465084288:12345-0@lo:400:kworker.0 Request processed in 47us (616us total) trans 0 rc 0/0 00000100:00080000:3.0:1785219815.343742:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785219815.343745:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785219815.343750:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1785219815.343790:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cef0e00 x1871938465084416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219815.343804:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465084416:0@lo:400:kworker.0 00000100:00100000:3.0:1785219815.343817:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465084288:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.346536:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465084160:0@lo:400:kworker.0 00010000:00080000:0.0:1785219815.346570:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36cef1880 x1871938465084672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219815.346583:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465084672:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.346598:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465084032:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.346611:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465084544:0@lo:400:kworker.0 00000100:00100000:0.0:1785219815.456355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219815.456407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219815.456428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219815.456448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219815.456678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219815.459835:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080256 00000100:00100000:2.0:1785219815.460464:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080256 00000100:00100000:2.0:1785219815.460555:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080128 00000100:00100000:2.0:1785219815.460560:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080128 00000100:00100000:2.0:1785219815.460599:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1785219815.460610:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444080256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:3.0:1785219815.461079:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785219815.461085:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785219815.461102:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1785219815.461112:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2361:x1871938444080128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219815.462804:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444079744 00000100:00100000:0.0:1785219815.462816:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444079744 00000100:00100000:0.0:1785219815.462890:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:0.0:1785219815.462899:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444079744:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219815.464244:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2361:x1871938444080128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3111us (7544us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219815.464260:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1785219815.465553:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444080256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 4933us (9110us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219815.465566:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1785219815.467588:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444079744:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 4678us (11244us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.467619:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:0.0:1785219815.467700:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080000 00000100:00100000:0.0:1785219815.467710:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080000 00000100:00100000:0.0:1785219815.467773:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444079872 00000100:00100000:0.0:1785219815.467776:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444079872 00000100:00100000:0.0:1785219815.467797:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1785219815.467804:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444080000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219815.467863:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444080000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 60us (11455us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.467869:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1785219815.467883:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:0.0:1785219815.467888:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444079872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219815.467906:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444079872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 19us (11458us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219815.467911:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00080000:3.0:1785219815.468401:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785219815.790586:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219815.857573:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219815.857609:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465084800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219815.857762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219815.857857:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084800 00000100:00100000:3.0:1785219815.857867:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084800 00000100:00100000:3.0:1785219815.857928:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1785219815.857939:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465084800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219815.859102:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219815.859220:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465084800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1279us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219815.859232:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1785219815.859445:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348930000 x1871938465084800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219815.859474:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465084800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785219816.813126:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219817.839562:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219817.900240:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465084928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219817.900312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219817.900422:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465084928 00000100:00100000:1.0:1785219817.900430:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465084928 00000100:00100000:1.0:1785219817.900484:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785219817.900495:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465084928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219817.900533:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219817.900583:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465084928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219817.900590:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1785219817.900609:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785219817.900647:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf37eb05180 x1871938465084928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219817.900663:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465084928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785219818.860933:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219819.883692:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219820.462569:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465085312:0@lo:400:kworker.0 00000100:00100000:1.0:1785219820.462667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219820.462750:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219820.462758:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465085440:0@lo:400:kworker.0 00000100:00100000:1.0:1785219820.462791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219820.462848:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085440 00000100:00100000:1.0:1785219820.462857:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085440 00000100:00100000:1.0:1785219820.462933:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1785219820.462944:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465085440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219820.463004:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465085440:12345-0@lo:400:kworker.0 Request processed in 62us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219820.463012:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1785219820.463035:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785219820.463069:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348930700 x1871938465085440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219820.463085:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465085440:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.463097:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465085056:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.463307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219820.463338:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465085568:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.463627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219820.463653:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785219820.463661:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465085184:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.463685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219820.463704:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465085696:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.463727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219820.463766:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085312 00000100:00100000:0.0:1785219820.463772:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085312 00000100:00100000:0.0:1785219820.463820:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085568 00000100:00100000:0.0:1785219820.463824:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085568 00000100:00100000:0.0:1785219820.463840:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085184 00000100:00100000:0.0:1785219820.463842:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085184 00000100:00100000:0.0:1785219820.463855:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1785219820.463862:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465085312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.463914:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465085312:12345-0@lo:400:kworker.0 Request processed in 51us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219820.463921:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1785219820.463937:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1785219820.463944:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465085568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.464044:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465085568:12345-0@lo:400:kworker.0 Request processed in 101us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219820.464051:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1785219820.464063:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785219820.464069:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465085184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.464091:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465085184:12345-0@lo:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219820.464108:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785219820.464136:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085056 00000100:00100000:0.0:1785219820.464140:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085056 00000100:00100000:0.0:1785219820.464464:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1785219820.464473:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465085056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.464512:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465085056:12345-0@lo:400:kworker.0 Request processed in 41us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219820.464520:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1785219820.464554:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465085312:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.464644:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085696 00000100:00100000:0.0:1785219820.464648:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085696 00000100:00100000:0.0:1785219820.464694:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1785219820.464702:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.464737:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465085696:12345-0@lo:400:kworker.0 Request processed in 36us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219820.464744:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1785219820.464772:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785219820.464778:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219820.464806:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465085184:0@lo:400:kworker.0 00010000:00080000:0.0:1785219820.464821:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348932a00 x1871938465085696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219820.464833:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465085696:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.464844:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465085056:0@lo:400:kworker.0 00000100:00100000:0.0:1785219820.464857:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465085568:0@lo:400:kworker.0 00000100:00100000:2.0:1785219820.565055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219820.565107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219820.565133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219820.565159:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219820.565247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219820.565279:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080640 00000100:00100000:2.0:1785219820.565291:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080640 00000100:00100000:2.0:1785219820.565399:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080512 00000100:00100000:2.0:1785219820.565403:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080512 00000100:00100000:3.0:1785219820.566743:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080384 00000100:00100000:3.0:1785219820.566754:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080384 00000100:00100000:3.0:1785219820.566920:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:3.0:1785219820.566933:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444080384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219820.567040:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444080384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 109us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219820.567048:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:2.0:1785219820.567386:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1785219820.567397:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2361:x1871938444080640:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219820.568591:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2361:x1871938444080640:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1188us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219820.568604:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1785219820.569076:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1785219820.569089:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444080512:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219820.569134:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444080512:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 50us (4001us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219820.569150:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1785219820.569177:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080768 00000100:00100000:2.0:1785219820.569186:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080768 00000100:00100000:2.0:1785219820.569238:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444080896 00000100:00100000:2.0:1785219820.569242:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444080896 00000100:00100000:2.0:1785219820.569271:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1785219820.569278:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2358:x1871938444080768:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:2.0:1785219820.569310:0:6588:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c81f 00000100:00080000:2.0:1785219820.569320:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9cf36cda4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785219820.569396:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1785219820.570892:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1785219820.570920:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2358:x1871938444080896:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:0.0:1785219820.570950:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c826 00000100:00080000:0.0:1785219820.570959:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9cf3811b3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785219820.571011:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1785219820.572925:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+2:2358:x1871938444080768:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 3632us (7750us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219820.572943:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00080000:2.0:1785219820.572994:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219820.573000:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785219820.573004:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785219820.573029:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219820.573188:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+2:2358:x1871938444080896:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 2274us (7940us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219820.573196:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:3.0:1785219820.573351:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219820.919467:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219820.972640:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465085824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219820.972747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219820.972968:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085824 00000100:00100000:0.0:1785219820.972979:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085824 00000100:00100000:0.0:1785219820.973046:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785219820.973057:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465085824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785219820.973107:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219820.973173:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465085824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219820.973181:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1785219820.973237:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc02a00 x1871938465085824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219820.973261:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465085824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785219821.931804:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785219822.728099:0:10864:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1785219822.962024:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219823.020492:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465085952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219823.020585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219823.020671:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465085952 00000100:00100000:2.0:1785219823.020681:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465085952 00000100:00100000:2.0:1785219823.020751:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1785219823.020762:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465085952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785219823.020806:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219823.020869:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465085952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219823.020877:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1785219823.020905:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785219823.020938:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf24727b800 x1871938465085952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219823.020962:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465085952:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1785219823.631958:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00000020:00000080:2.0:1785219823.631973:0:6614:0:(genops.c:906:class_export_put()) final put ffff9cf36cda6000/440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00000020:00000080:1.0:1785219823.639813:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cda6000/440d444c-61d3-4ab8-9ade-966ffdd2cbcf for lustre-OST0000 00000020:00000080:1.0:1785219823.639888:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf36cda4000 for lustre-OST0000 00010000:00010000:0.0:1785219823.979649:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785219824.622222:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00000020:00000080:3.0:1785219824.622233:0:7492:0:(genops.c:906:class_export_put()) final put ffff9cf3811b1800/440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00000020:00000080:2.0:1785219824.622339:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf3811b1800/440d444c-61d3-4ab8-9ade-966ffdd2cbcf for lustre-OST0001 00000020:00000080:2.0:1785219824.622712:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf3811b3800 for lustre-OST0001 00010000:00010000:1.0:1785219825.006946:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219825.582441:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465086208:0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.582515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219825.582574:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465086720:0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.582615:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219825.582833:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1785219825.582854:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465086080:0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.582900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219825.582925:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465086592:0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.582949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219825.582975:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465086464:0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.583000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219825.583017:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219825.583024:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465086336:0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.583047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219825.583077:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465086208 00000100:00100000:0.0:1785219825.583084:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465086208 00000100:00100000:0.0:1785219825.583345:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465086592 00000100:00100000:0.0:1785219825.583350:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465086592 00000100:00100000:0.0:1785219825.583409:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465086336 00000100:00100000:0.0:1785219825.583412:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465086336 00000100:00100000:0.0:1785219825.583429:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1785219825.583436:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465086208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.583494:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465086208:12345-0@lo:400:kworker.0 Request processed in 57us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219825.583501:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1785219825.583521:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785219825.583527:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465086592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.583557:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465086592:12345-0@lo:400:kworker.0 Request processed in 30us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219825.583563:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785219825.583575:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1785219825.583582:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465086336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219825.584430:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465086720 00000100:00100000:2.0:1785219825.584439:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465086720 00000100:00100000:2.0:1785219825.584482:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465086464 00000100:00100000:2.0:1785219825.584486:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465086464 00000100:00100000:2.0:1785219825.584510:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785219825.584518:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219825.584577:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465086720:12345-0@lo:400:kworker.0 Request processed in 60us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219825.584583:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785219825.584611:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785219825.584617:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465086464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219825.584796:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465086464:12345-0@lo:400:kworker.0 Request processed in 179us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219825.584802:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1785219825.584963:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785219825.584968:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785219825.584971:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785219825.585013:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348064a80 x1871938465086464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219825.585045:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465086464:0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.586588:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465086336:12345-0@lo:400:kworker.0 Request processed in 3002us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219825.586608:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1785219825.586875:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465086080 00000100:00100000:0.0:1785219825.586883:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465086080 00000100:00100000:0.0:1785219825.586924:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1785219825.586931:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219825.586971:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465086080:12345-0@lo:400:kworker.0 Request processed in 40us (4070us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219825.586977:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1785219825.591446:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465086336:0@lo:400:kworker.0 00000100:00100000:3.0:1785219825.594355:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465086080:0@lo:400:kworker.0 00000100:00100000:3.0:1785219825.597579:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465086592:0@lo:400:kworker.0 00000100:00100000:3.0:1785219825.597607:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465086208:0@lo:400:kworker.0 00010000:00080000:3.0:1785219825.597666:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348066d80 x1871938465086720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219825.597678:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465086720:0@lo:400:kworker.0 00000100:00100000:1.0:1785219825.688702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219825.688752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219825.688786:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219825.688818:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081152 00000100:00100000:1.0:1785219825.688840:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081152 00000100:00100000:1.0:1785219825.688898:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081280 00000100:00100000:1.0:1785219825.688902:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081280 00000100:00100000:1.0:1785219825.688927:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:1.0:1785219825.688937:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444081152:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219825.689031:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444081152:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 95us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219825.689039:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:1.0:1785219825.689057:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:1.0:1785219825.689064:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444081280:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219825.689092:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444081280:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219825.689098:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00080000:1.0:1785219825.689115:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219825.689600:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081024 00000100:00100000:0.0:1785219825.689606:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081024 00000100:00100000:0.0:1785219825.689649:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:0.0:1785219825.689657:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444081024:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219825.689696:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444081024:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 40us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219825.689703:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 226 00010000:00010000:0.0:1785219826.028545:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219826.091700:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785219826.097473:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465086848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785219826.097560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219826.101479:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465086848 00000100:00100000:2.0:1785219826.101504:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465086848 00000100:00100000:2.0:1785219826.101574:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785219826.102461:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465086848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785219826.102514:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219826.102866:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465086848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1280us (5302us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219826.102875:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1785219826.107546:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f1f80 x1871938465086848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219826.107574:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465086848:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1785219826.312918:0:11014:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9117d310 20000000:00000080:1.0:1785219826.312936:0:11014:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf381b73400 uarg=0000000000000000 20000000:01000000:1.0:1785219826.312975:0:11014:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785219826.312982:0:11014:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785219826.312988:0:11014:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1785219826.318093:0:11015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1785219826.318347:0:11014:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1785219826.328989:0:11014:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785219826.329107:0:11014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329132:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329141:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329149:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329156:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329162:0:11014:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329169:0:11014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329233:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329275:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 12 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219826.329292:0:11014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465086976:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219826.329431:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329440:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 18 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219826.329450:0:11014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348933100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087104:0@lo:104: 00000100:00100000:3.0:1785219826.329494:0:11014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785219826.329532:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329541:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 18 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219826.329551:0:11014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087232:0@lo:104: 00000100:00100000:3.0:1785219826.329573:0:11014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785219826.329603:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329612:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 18 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219826.329621:0:11014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087360:0@lo:104: 00000100:00100000:3.0:1785219826.329642:0:11014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785219826.329678:0:11014:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219826.329702:0:11014:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 12 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219826.329712:0:11014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087488:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219826.329715:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465087104 00000100:00100000:2.0:1785219826.329724:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465087104 00000100:00100000:3.0:1785219826.329744:0:11014:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4540 going to sleep for 11 seconds 00000100:00100000:2.0:1785219826.329770:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465087232 00000100:00100000:2.0:1785219826.329775:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465087232 00000100:00100000:2.0:1785219826.329789:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465087360 00000100:00100000:2.0:1785219826.329792:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465087360 00000100:00100000:2.0:1785219826.329807:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785219826.329816:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+5:11014:x1871938465087104:12345-0@lo:104: 00010000:00010000:2.0:1785219826.329829:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.329892:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785219826.329900:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+5:11014:x1871938465087104:12345-0@lo:104: Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219826.329917:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785219826.329927:0:11014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348933100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087104:0@lo:104: 00000100:00100000:2.0:1785219826.329941:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785219826.329949:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:11014:x1871938465087232:12345-0@lo:104: 00010000:00010000:2.0:1785219826.329958:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330007:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785219826.330014:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+4:11014:x1871938465087232:12345-0@lo:104: Request processed in 67us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219826.330020:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785219826.330034:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785219826.330042:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348931500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:11014:x1871938465087360:12345-0@lo:104: 00010000:00010000:2.0:1785219826.330051:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330084:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1785219826.330089:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348931500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+3:11014:x1871938465087360:12345-0@lo:104: Request processed in 50us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219826.330094:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1785219826.330115:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785219826.330122:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330131:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cd600 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219826.330136:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330155:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219826.330163:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219826.330169:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785219826.330200:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330207:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219826.330227:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330234:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c7f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330248:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785219826.330251:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330763:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07200 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219826.330769:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330777:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219826.330783:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219826.330794:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785219826.330812:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330817:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219826.330832:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330838:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f07200/0x8b38d407a078c7e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7ee expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330848:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219826.330852:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330857:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81600 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219826.330860:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330868:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219826.330874:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219826.330878:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785219826.330889:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330894:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219826.330906:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330912:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f81600/0x8b38d407a078c7d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c7e0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.330924:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219826.330926:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219826.330928:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219826.330936:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219826.330960:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465087616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219826.331017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219826.331202:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465087872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219826.331235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219826.331274:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785219826.331280:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465087744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219826.331310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219826.331343:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465087616 00000100:00100000:1.0:1785219826.331349:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465087616 00010000:00010000:1.0:1785219826.331395:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 19 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219826.331420:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465087872 00000100:00100000:1.0:1785219826.331424:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465087872 00010000:00010000:1.0:1785219826.331434:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 20 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219826.331444:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465087744 00000100:00100000:1.0:1785219826.331446:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465087744 00010000:00010000:1.0:1785219826.331454:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 21 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219826.331466:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785219826.331472:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+21:3307:x1871938465087616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219826.331483:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219826.331489:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 21 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219826.331498:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 21 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219826.331512:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07c00/0x8b38d407a078c7fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c7f5 expref: 21 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219826.331525:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219826.331557:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+20:3307:x1871938465087616:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219826.331575:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785219826.331622:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785219826.331628:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465087872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219826.331634:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219826.331638:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 19 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219826.331645:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 19 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219826.331654:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219826.331678:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465087872:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219826.331684:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785219826.331696:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785219826.331701:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:3309:x1871938465087744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219826.331707:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219826.331710:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 18 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219826.331717:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 18 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219826.331725:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219826.331745:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:3309:x1871938465087744:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219826.331751:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785219826.331790:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465087616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219826.331823:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465087744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219826.331830:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465087872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785219826.332136:0:11014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c7ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c7e7 expref: 17 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219826.332147:0:11014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087232:0@lo:104: 00010000:00010000:3.0:1785219826.332158:0:11014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341476400/0x8b38d407a078c7e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c7d9 expref: 16 pid: 5785 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219826.332166:0:11014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087360:0@lo:104: 00000100:00100000:2.0:1785219826.336098:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219826.336121:0:11014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465086976:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219826.336137:0:11014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11014:1871938465087488:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219826.336174:0:11014:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219826.336184:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219826.336265:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081408 00000100:00100000:0.0:1785219826.336273:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081408 00010000:00010000:0.0:1785219826.336309:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 13 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219826.336344:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081536 00000100:00100000:0.0:1785219826.336348:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081536 00010000:00010000:0.0:1785219826.336383:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 14 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219826.336426:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1785219826.336435:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+14:2361:x1871938444081408:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219826.336449:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219826.336455:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 14 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336466:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 14 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336482:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c811 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f290 expref: 14 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336498:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219826.336547:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444081408:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 113us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219826.336555:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1785219826.336571:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1785219826.336577:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:2361:x1871938444081536:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219826.336586:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219826.336591:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 12 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336599:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 12 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336610:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341477a00/0x8b38d407a078c7d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f258 expref: 12 pid: 5788 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336631:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336640:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336654:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336660:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336666:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336672:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336678:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219826.336695:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336702:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336722:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219826.336731:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219826.336751:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2361:x1871938444081536:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 174us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219826.336764:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00010000:00010000:2.0:1785219826.336782:0:11014:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.336792:0:11014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219826.336798:0:11014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c82d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219827.055954:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785219828.011764:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785219828.011773:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf37e4b1000 from 7 10000000:01000000:2.0:1785219828.011778:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785219828.011829:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.011840:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.011865:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219828.011894:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785219828.011969:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219828.012044:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf344ce2240 going to sleep for 11 seconds 00000100:00100000:3.0:1785219828.012179:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088000 00000100:00100000:3.0:1785219828.012189:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088000 00000100:00100000:3.0:1785219828.012263:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1785219828.012273:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465088000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219828.012288:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219828.012310:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c834 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219828.012336:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c834 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219828.012347:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c834 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219828.012357:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06e00, rc 0) 00000100:00100000:3.0:1785219828.012423:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465088000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219828.012430:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1785219828.012619:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219828.012636:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.012644:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219828.012697:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219828.012724:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219828.012752:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf344ce2240 going to sleep for 11 seconds 00000100:00100000:0.0:1785219828.012861:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088128 00000100:00100000:0.0:1785219828.012867:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088128 00000100:00100000:0.0:1785219828.012899:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1785219828.012906:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465088128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.013172:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465088128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219828.013180:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1785219828.013359:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219828.013422:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219828.013466:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219828.013483:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf344ce2240 going to sleep for 11 seconds 00000100:00100000:0.0:1785219828.013546:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088256 00000100:00100000:0.0:1785219828.013552:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088256 00000100:00100000:0.0:1785219828.013593:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1785219828.013600:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465088256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.013770:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465088256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219828.013777:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1785219828.013818:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785219828.014466:0:11070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1785219828.014516:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1785219828.014532:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785219828.014542:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.014551:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219828.014560:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785219828.014571:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf349c7c000 from 7 10000000:01000000:0.0:1785219828.014574:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785219828.014603:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.014610:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.014619:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219828.014638:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.014672:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219828.014692:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1785219828.014706:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088384 00000100:00100000:0.0:1785219828.014711:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088384 00000100:00100000:0.0:1785219828.014733:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1785219828.014740:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465088384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219828.014749:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219828.014760:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c842 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.014782:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c842 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.014792:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c842 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.014801:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1a00, rc 0) 00000100:00100000:0.0:1785219828.014832:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465088384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219828.014845:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1785219828.014883:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219828.014895:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.014902:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219828.014941:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.014965:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219828.014977:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1785219828.014986:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088512 00000100:00100000:0.0:1785219828.014990:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088512 00000100:00100000:0.0:1785219828.015005:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1785219828.015010:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465088512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.015206:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465088512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219828.015212:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1785219828.015238:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.015276:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.015309:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219828.015321:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1785219828.015332:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088640 00000100:00100000:0.0:1785219828.015335:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088640 00000100:00100000:0.0:1785219828.015351:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1785219828.015385:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465088640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.015509:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465088640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219828.015515:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1785219828.015548:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1785219828.017925:0:11071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1785219828.018473:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1785219828.018495:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785219828.018506:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.018518:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219828.018529:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785219828.018531:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf3503a5000 from 7 10000000:01000000:0.0:1785219828.018534:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785219828.018570:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.018586:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.018598:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219828.018622:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.018686:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219828.018727:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350f71600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219828.022428:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088768 00000100:00100000:2.0:1785219828.022446:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088768 00000100:00100000:2.0:1785219828.022523:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1785219828.022534:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465088768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219828.022560:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219828.022578:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c850 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.022607:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c850 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.022620:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c850 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.022630:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80e00, rc 0) 00000100:00100000:2.0:1785219828.022713:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465088768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4027us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219828.022721:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1785219828.023061:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219828.023082:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.023093:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219828.023164:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.023203:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219828.023241:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465088896 00000100:00100000:2.0:1785219828.023256:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465088896 00000100:00100000:2.0:1785219828.023285:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1785219828.023292:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465088896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.023323:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350f71600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219828.023579:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465088896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219828.023587:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1785219828.023678:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465088896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.023709:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465089024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.023749:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219828.023777:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350f71600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219828.023797:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089024 00000100:00100000:2.0:1785219828.023802:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089024 00000100:00100000:2.0:1785219828.023872:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1785219828.023890:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465089024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219828.024030:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465089024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219828.024046:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1785219828.024760:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465089024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785219828.030486:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1785219828.030658:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1785219828.030677:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785219828.030688:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.030700:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219828.076878:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219828.140330:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465089152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219828.140428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219828.140515:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089152 00000100:00100000:2.0:1785219828.140524:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089152 00000100:00100000:2.0:1785219828.140582:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1785219828.140591:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465089152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785219828.140627:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219828.140677:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465089152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219828.140684:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1785219828.140707:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785219828.140740:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c5500 x1871938465089152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219828.140758:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465089152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219828.307978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219828.316055:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081664 00000100:00100000:2.0:1785219828.316072:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081664 00000100:00100000:2.0:1785219828.316150:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:2.0:1785219828.316169:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:5576:x1871938444081664:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219828.316189:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219828.316301:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2ba expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.316333:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.316440:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219828.316451:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81c00, rc 0) 00000100:00100000:2.0:1785219828.316517:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444081664:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 351us (8550us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219828.316524:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:1.0:1785219828.327120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219828.327196:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081792 00000100:00100000:2.0:1785219828.327208:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081792 00000100:00100000:2.0:1785219828.327270:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:2.0:1785219828.327281:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444081792:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219828.327615:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444081792:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 335us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219828.327624:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:3.0:1785219828.342309:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219828.342465:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444081920 00000100:00100000:1.0:1785219828.342476:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444081920 00000100:00100000:1.0:1785219828.342533:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:1.0:1785219828.342545:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444081920:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219828.353809:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444081920:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 11257us (11501us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219828.353823:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:1.0:1785219828.368445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219828.368891:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082048 00000100:00100000:3.0:1785219828.368910:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082048 00000100:00100000:3.0:1785219828.368990:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:3.0:1785219828.369002:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444082048:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219828.369025:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219828.369063:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2c1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219828.369101:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219828.369115:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219828.369126:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06000, rc 0) 00000100:00100000:3.0:1785219828.369256:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444082048:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 245us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219828.369264:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:0.0:1785219828.386785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219828.387404:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082176 00000100:00100000:1.0:1785219828.387415:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082176 00000100:00100000:1.0:1785219828.387478:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:1.0:1785219828.387489:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444082176:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219828.387918:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444082176:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 424us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219828.387931:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:3.0:1785219828.402566:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219828.404433:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082304 00000100:00100000:0.0:1785219828.404452:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082304 00000100:00100000:0.0:1785219828.404551:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:0.0:1785219828.404565:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444082304:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219828.408252:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444082304:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 3661us (5677us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219828.408275:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00010000:00010000:2.0:1785219829.099637:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219830.124190:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219830.699981:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465089280:0@lo:400:kworker.0 00000100:00100000:1.0:1785219830.700223:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465089408:0@lo:400:kworker.0 00000100:00100000:1.0:1785219830.700306:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219830.700469:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465089920:0@lo:400:kworker.0 00000100:00100000:0.0:1785219830.700678:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089408 00000100:00100000:0.0:1785219830.700687:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089408 00000100:00100000:0.0:1785219830.700758:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785219830.700769:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465089408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.700862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219830.701040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219830.701068:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465089792:0@lo:400:kworker.0 00000100:00100000:1.0:1785219830.701104:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785219830.701118:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465089536:0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.701147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219830.701180:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785219830.701188:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465089664:0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.701218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219830.701283:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089920 00000100:00100000:1.0:1785219830.701290:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219830.701293:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089920 00000100:00100000:2.0:1785219830.701398:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089664 00000100:00100000:2.0:1785219830.701404:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089664 00000100:00100000:2.0:1785219830.701438:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785219830.701455:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465089920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.701520:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465089920:12345-0@lo:400:kworker.0 Request processed in 74us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219830.701528:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785219830.701546:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785219830.701552:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465089664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.701587:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465089664:12345-0@lo:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219830.701592:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785219830.701623:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089792 00000100:00100000:2.0:1785219830.701627:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089792 00000100:00100000:0.0:1785219830.701759:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465089408:12345-0@lo:400:kworker.0 Request processed in 989us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219830.701770:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785219830.701796:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089536 00000100:00100000:0.0:1785219830.701802:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089536 00000100:00100000:0.0:1785219830.701839:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1785219830.701847:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465089536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219830.701882:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465089536:12345-0@lo:400:kworker.0 Request processed in 37us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219830.701888:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785219830.702167:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465089280 00000100:00100000:1.0:1785219830.702173:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465089280 00000100:00100000:1.0:1785219830.702210:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1785219830.702217:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465089280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219830.702264:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465089280:12345-0@lo:400:kworker.0 Request processed in 48us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219830.702271:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1785219830.705714:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1785219830.705889:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785219830.705901:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219830.705903:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465089792:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1785219830.705907:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785219830.705980:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3812f1f80 x1871938465089664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219830.706003:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465089664:0@lo:400:kworker.0 00000100:00100000:0.0:1785219830.706014:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465089792:12345-0@lo:400:kworker.0 Request processed in 281us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219830.706024:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1785219830.706032:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465089792:0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.706066:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465089280:0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.706134:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465089536:0@lo:400:kworker.0 00000100:00100000:2.0:1785219830.706149:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465089408:0@lo:400:kworker.0 00010000:00080000:2.0:1785219830.706164:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348a38e00 x1871938465089920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219830.706173:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465089920:0@lo:400:kworker.0 00000100:00100000:1.0:1785219830.807594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219830.807639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219830.807669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219830.807704:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082560 00000100:00100000:1.0:1785219830.807715:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082560 00000100:00100000:1.0:1785219830.807775:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082688 00000100:00100000:1.0:1785219830.807778:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082688 00000100:00100000:1.0:1785219830.807802:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1785219830.807813:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444082560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219830.807907:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2360:x1871938444082560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 95us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219830.807915:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1785219830.807935:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1785219830.807942:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444082688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219830.807969:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444082688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219830.807975:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00080000:2.0:1785219830.809310:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219830.810515:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082432 00000100:00100000:0.0:1785219830.810531:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082432 00000100:00100000:0.0:1785219830.811317:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 243 00000100:00100000:0.0:1785219830.811332:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444082432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219830.811453:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444082432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 124us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219830.811461:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 243 00000001:02000400:1.0:1785219830.822845:0:11213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1785219831.147636:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219831.211996:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219831.213276:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465090048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219831.213348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219831.213518:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090048 00000100:00100000:1.0:1785219831.213527:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090048 00000100:00100000:1.0:1785219831.213579:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785219831.213589:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465090048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219831.213626:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219831.213691:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465090048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219831.213698:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1785219831.213938:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348a3ad80 x1871938465090048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219831.213957:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465090048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785219832.171745:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219833.196488:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219833.259614:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465090176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219833.259695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219833.260009:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090176 00000100:00100000:2.0:1785219833.260018:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090176 00000100:00100000:2.0:1785219833.260092:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1785219833.260102:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465090176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785219833.260136:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219833.260194:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465090176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219833.260201:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1785219833.260599:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785219833.260681:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c5880 x1871938465090176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219833.260702:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465090176:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1785219834.130747:0:11312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:23:52 (1785219832) === 00010000:00010000:3.0:1785219834.221909:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219834.433274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.433411:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.433988:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082944 00000100:00100000:3.0:1785219834.433998:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082944 00000100:00100000:3.0:1785219834.434070:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1785219834.434081:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:9685:x1871938444082944:12345-192.168.203.31@tcp:700:mkdir.0 00000100:00100000:3.0:1785219834.434227:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:9685:x1871938444082944:12345-192.168.203.31@tcp:700:mkdir.0 Request processed in 148us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219834.434235:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00080000:0.0:1785219834.434383:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219834.434451:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444082816 00000100:00100000:2.0:1785219834.434457:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444082816 00000100:00100000:2.0:1785219834.434492:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1785219834.434499:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444082816:12345-192.168.203.31@tcp:41:mkdir.0 00000004:00000024:2.0:1785219834.434545:0:8055:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785219834.434609:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444082816:12345-192.168.203.31@tcp:41:mkdir.0 Request processed in 110us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219834.434616:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1785219834.437483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.437653:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444083200 00000100:00100000:2.0:1785219834.437664:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444083200 00000100:00100000:2.0:1785219834.437725:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1785219834.437738:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:9685:x1871938444083200:12345-192.168.203.31@tcp:36:mkdir.0 00010000:00010000:2.0:1785219834.437801:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219834.438017:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c74d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f243 expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.438044:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:2.0:1785219834.438058:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219834.440532:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.440555:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.440568:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.440616:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.440625:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.440756:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219834.445115:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1785219834.445138:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.445715:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.445727:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.445735:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.445739:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.445748:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.445767:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219834.445770:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.445775:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.445799:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c86c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219834.446087:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb02d96c reply state 00000000f97cc40f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219834.446098:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785219834.446237:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9685:x1871938444083200:12345-192.168.203.31@tcp:36:mkdir.0 Request processed in 8498us (8760us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1785219834.446245:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00010000:00010000:1.0:1785219834.452248:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.452265:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.452275:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.452281:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219834.452297:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.452306:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.452324:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf356788f00) 00010000:00010000:1.0:1785219834.452341:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219834.452348:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.452355:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c873 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219834.470549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.470618:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444083328 00000100:00100000:2.0:1785219834.470629:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444083328 00000100:00100000:2.0:1785219834.470759:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1785219834.470770:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:9686:x1871938444083328:12345-192.168.203.31@tcp:101:chmod.0 00010000:00010000:2.0:1785219834.470793:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219834.471233:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c87a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2c8 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.471302:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c881 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.471316:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.471346:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219834.471581:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1785219834.471585:0:8055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219834.471627:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.471735:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c87a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c8 expref: 8 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.471754:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c8 expref: 7 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.471763:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219834.471767:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785219834.471771:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:2.0:1785219834.472742:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9686:x1871938444083328:12345-192.168.203.31@tcp:101:chmod.0 Request processed in 1969us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219834.472752:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1785219834.476229:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.476782:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444083584 00000100:00100000:1.0:1785219834.476794:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444083584 00000100:00100000:1.0:1785219834.476893:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1785219834.476903:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9686:x1871938444083584:12345-192.168.203.31@tcp:36:chmod.0 00010000:00010000:1.0:1785219834.476962:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219834.476988:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c8 expref: 7 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.477008:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:1.0:1785219834.477018:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219834.477041:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.477064:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.477072:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785219834.477430:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f2f5b03 reply state 0000000077860a21 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219834.477440:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1785219834.477473:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1785219834.477798:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:9686:x1871938444083584:12345-192.168.203.31@tcp:36:chmod.0 Request processed in 895us (1576us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1785219834.477807:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00010000:00010000:3.0:1785219834.479410:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.479425:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.479432:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.479448:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.479453:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.479460:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.479476:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:3.0:1785219834.479480:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785219834.479484:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.479500:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c888 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219834.510888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.511125:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444083712 00000100:00100000:2.0:1785219834.511136:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444083712 00000100:00100000:2.0:1785219834.511210:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1785219834.511221:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9687:x1871938444083712:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:2.0:1785219834.511246:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219834.511271:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c88f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2cf expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.511411:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078c896 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.511425:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078c896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.511437:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078c896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219834.511498:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1785219834.511502:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219834.511555:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078c896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.511581:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c88f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2cf expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.511599:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078c896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2cf expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.511608:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd800) 00010000:00010000:2.0:1785219834.511611:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785219834.511615:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81600, rc 0) 00000100:00100000:2.0:1785219834.511676:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:9687:x1871938444083712:12345-192.168.203.31@tcp:101:chown.0 Request processed in 455us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219834.511683:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1785219834.518236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.518520:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444083840 00000100:00100000:3.0:1785219834.518540:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444083840 00000100:00100000:3.0:1785219834.518600:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1785219834.518610:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:9687:x1871938444083840:12345-192.168.203.31@tcp:101:chown.0 00010000:00010000:3.0:1785219834.518633:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219834.518656:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c89d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2d6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518724:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518740:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518751:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518769:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518776:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518782:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518894:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c8b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518903:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518910:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219834.518948:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1785219834.518953:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219834.518978:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518992:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.518999:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519007:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519015:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341477a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.519019:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519027:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519040:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd800) 00010000:00010000:3.0:1785219834.519049:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.519055:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519062:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519077:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519083:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519089:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519093:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.519096:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519102:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519109:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf356788100) 00010000:00010000:3.0:1785219834.519112:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.519115:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519121:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519149:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c89d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2d6 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519175:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2d6 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.519182:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788500) 00010000:00010000:3.0:1785219834.519185:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219834.519187:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476000, rc 0) 00000100:00100000:3.0:1785219834.519262:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:9687:x1871938444083840:12345-192.168.203.31@tcp:101:chown.0 Request processed in 654us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219834.519270:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1785219834.527464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.527567:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444084096 00000100:00100000:2.0:1785219834.527578:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444084096 00000100:00100000:2.0:1785219834.527664:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1785219834.527675:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:9687:x1871938444084096:12345-192.168.203.31@tcp:36:chown.0 00010000:00010000:2.0:1785219834.527726:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219834.527754:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c8b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2d6 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.527775:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788500) 00010000:00010000:2.0:1785219834.527788:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219834.527815:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.527829:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.527840:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785219834.618446:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1785219834.618481:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1785219834.618663:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d96efe1e reply state 00000000a31611aa transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219834.618677:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1785219834.618881:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1785219834.618991:0:5795:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1785219834.619015:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9687:x1871938444084096:12345-192.168.203.31@tcp:36:chown.0 Request processed in 91338us (91557us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1785219834.619024:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00010000:00010000:3.0:1785219834.619248:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.619258:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.619265:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.619272:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.619276:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.619284:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.619300:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf345fcd100) 00010000:00010000:3.0:1785219834.619311:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785219834.619318:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.619324:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219834.641535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.641674:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444084224 00000100:00100000:2.0:1785219834.641685:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444084224 00000100:00100000:2.0:1785219834.641756:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1785219834.641769:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:9688:x1871938444084224:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:2.0:1785219834.641809:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219834.641833:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2dd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785219834.646476:0:5793:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4589us 00010000:00010000:3.0:1785219834.668466:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668487:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668501:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668515:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668522:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668529:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668961:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668971:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.668979:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219834.669067:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785219834.669072:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219834.669179:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669194:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669211:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669218:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669225:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.669229:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669237:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669249:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd800) 00010000:00010000:3.0:1785219834.669252:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.669256:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669263:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669273:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669291:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669297:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669302:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.669306:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669311:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669319:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf356788600) 00010000:00010000:3.0:1785219834.669321:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.669324:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669330:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c8ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669401:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c8c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2dd expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669418:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2dd expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.669426:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219834.669429:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1785219834.669438:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341477a00, rc 0) 00000100:00100000:3.0:1785219834.669511:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9688:x1871938444084224:12345-192.168.203.31@tcp:101:touch.500 Request processed in 27744us (27985us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219834.669520:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1785219834.674308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.674609:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444084480 00000100:00100000:1.0:1785219834.674620:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444084480 00000100:00100000:1.0:1785219834.675136:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1785219834.675149:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9688:x1871938444084480:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:1.0:1785219834.675172:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219834.675194:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078c8dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2e4 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.675595:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.675612:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.675624:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.675682:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.675690:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.675697:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785219834.676528:0:8055:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1785219834.676819:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c8f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676832:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676841:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676873:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676879:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676885:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676890:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219834.676894:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676902:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676913:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:1.0:1785219834.676916:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219834.676921:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.676927:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c8e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785219834.676952:0:8055:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000028834ada reply state 000000001548206a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219834.676963:0:8055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785219834.677000:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078c8dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2e4 expref: 10 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.677015:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2e4 expref: 9 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.677024:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf34a6a9200) 00010000:00010000:1.0:1785219834.677027:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219834.677030:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28600, rc 0) 00000100:00100000:1.0:1785219834.677115:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:9688:x1871938444084480:12345-192.168.203.31@tcp:101:touch.500 Request processed in 1968us (2827us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1785219834.677124:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00010000:00010000:3.0:1785219834.682851:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.682870:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.682878:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.682885:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.682890:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.682904:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.682923:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff9cf34a6a9300) 00010000:00010000:3.0:1785219834.682927:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.682932:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.682939:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078c8ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219834.685448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.685540:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444084736 00000100:00100000:1.0:1785219834.685552:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444084736 00000100:00100000:1.0:1785219834.685624:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1785219834.685635:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:9688:x1871938444084736:12345-192.168.203.31@tcp:36:touch.500 00010000:00010000:1.0:1785219834.685695:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219834.685725:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078c8f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2e4 expref: 9 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.685745:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf34a6a9200) 00010000:00010000:1.0:1785219834.685757:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219834.686014:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.686029:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.686040:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785219834.686177:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090841903 reply state 0000000060bb2d48 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219834.686187:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785219834.686286:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:9688:x1871938444084736:12345-192.168.203.31@tcp:36:touch.500 Request processed in 651us (844us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1785219834.686295:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00010000:00010000:3.0:1785219834.688304:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.688323:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.688353:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.688360:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.688391:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.688400:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.688418:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf34a6a9d00) 00010000:00010000:3.0:1785219834.688421:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.688426:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.688433:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078c8ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219834.691866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.692142:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444084864 00000100:00100000:2.0:1785219834.692153:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444084864 00000100:00100000:2.0:1785219834.692226:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1785219834.692238:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:9688:x1871938444084864:12345-192.168.203.31@tcp:101:touch.500 00010000:00010000:2.0:1785219834.692264:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219834.692288:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c906 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2eb expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.692360:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2eb expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.692400:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2eb expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.692421:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf345fcd700) 00010000:00010000:2.0:1785219834.692424:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785219834.692428:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:2.0:1785219834.692492:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:9688:x1871938444084864:12345-192.168.203.31@tcp:101:touch.500 Request processed in 257us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219834.692500:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1785219834.696087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.699314:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444084992 00000100:00100000:2.0:1785219834.699347:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444084992 00000100:00100000:2.0:1785219834.699429:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1785219834.699438:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1871938444084992:12345-192.168.203.31@tcp:8:touch.500 00010000:00080000:2.0:1785219834.699472:0:6588:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1785219834.699501:0:6588:0:(genops.c:1406:class_connect()) connect: client 3c48a627-3c4f-49d5-b2ec-dae54c1457bb, cookie 0x8b38d407a078c90d 00002000:00100000:2.0:1785219834.699524:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c48a627-3c4f-49d5-b2ec-dae54c1457bb/ffff9cf2462f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785219834.699536:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785219834.699776:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785219834.699809:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785219834.699887:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2358:x1871938444084992:12345-192.168.203.31@tcp:8:touch.500 Request processed in 447us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219834.699895:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1785219834.703934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.704251:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444085120 00000100:00100000:2.0:1785219834.704263:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444085120 00000100:00100000:2.0:1785219834.704344:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1785219834.704355:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:0:x1871938444085120:12345-192.168.203.31@tcp:2:touch.500 00000100:00080000:0.0:1785219834.705135:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1785219834.766861:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1785219834.766879:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000100:00100000:2.0:1785219834.767096:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:0:x1871938444085120:12345-192.168.203.31@tcp:2:touch.500 Request processed in 62738us (63168us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1785219834.767108:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:3.0:1785219834.772901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.773114:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444085376 00000100:00100000:1.0:1785219834.773125:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444085376 00000100:00100000:1.0:1785219834.773191:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785219834.773212:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:9688:x1871938444085376:12345-192.168.203.31@tcp:35:touch.500 00000100:00100000:1.0:1785219834.773612:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:9688:x1871938444085376:12345-192.168.203.31@tcp:35:touch.500 Request processed in 411us (719us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1785219834.773620:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785219834.789523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.789693:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444085504 00000100:00100000:3.0:1785219834.789705:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444085504 00000100:00100000:3.0:1785219834.789769:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:3.0:1785219834.789779:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:9689:x1871938444085504:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1785219834.789801:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219834.789822:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2f2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.789883:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c91b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.789911:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.789922:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219834.789981:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785219834.789984:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219834.790031:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c91b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.791439:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2f2 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.791468:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c91b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2f2 expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.791479:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219834.791481:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219834.791485:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476800, rc 0) 00000100:00100000:3.0:1785219834.791860:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:9689:x1871938444085504:12345-192.168.203.31@tcp:101:rm.0 Request processed in 2080us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219834.791868:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1785219834.797536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.798718:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444085760 00000100:00100000:3.0:1785219834.798731:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444085760 00000100:00100000:3.0:1785219834.798791:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1785219834.798800:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:9689:x1871938444085760:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1785219834.798819:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219834.798850:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f2f9 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219834.798953:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1785219834.799109:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c922 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2f9 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.799124:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd800) 00010000:00010000:3.0:1785219834.799127:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785219834.799132:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2f9 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.799144:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476000, rc 0) 00000100:00100000:3.0:1785219834.799198:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:9689:x1871938444085760:12345-192.168.203.31@tcp:101:rm.0 Request processed in 399us (1672us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1785219834.799219:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1785219834.804414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.804507:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444085888 00000100:00100000:1.0:1785219834.804523:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444085888 00000100:00100000:1.0:1785219834.804597:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1785219834.804608:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:9689:x1871938444085888:12345-192.168.203.31@tcp:37:rm.0 00000100:00100000:1.0:1785219834.810152:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:9689:x1871938444085888:12345-192.168.203.31@tcp:37:rm.0 Request processed in 5535us (5738us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219834.810167:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1785219834.815159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.815476:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444086144 00000100:00100000:1.0:1785219834.815487:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444086144 00000100:00100000:1.0:1785219834.815699:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1785219834.815710:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:9689:x1871938444086144:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:1.0:1785219834.815986:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:9689:x1871938444086144:12345-192.168.203.31@tcp:35:rm.0 Request processed in 276us (835us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1785219834.815994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1785219834.819011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219834.819359:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444086400 00000100:00100000:1.0:1785219834.819388:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444086400 00000100:00100000:1.0:1785219834.819491:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1785219834.819503:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:9689:x1871938444086400:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:1.0:1785219834.819541:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219834.819564:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078c930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f300 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.819695:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c937 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.819711:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.819723:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219834.819736:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1785219834.819886:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078c930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f300 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.819904:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f300 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.819913:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:1.0:1785219834.819916:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219834.819919:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28a00, rc 0) 00000100:00100000:1.0:1785219834.819985:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:9689:x1871938444086400:12345-192.168.203.31@tcp:101:rm.0 Request processed in 483us (984us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1785219834.819993:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1785219834.823460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.823730:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444086528 00000100:00100000:3.0:1785219834.823740:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444086528 00000100:00100000:3.0:1785219834.823792:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1785219834.823802:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:9689:x1871938444086528:12345-192.168.203.31@tcp:41:rm.0 00000004:00000024:3.0:1785219834.823862:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1785219834.823928:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:9689:x1871938444086528:12345-192.168.203.31@tcp:41:rm.0 Request processed in 128us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219834.823935:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:0.0:1785219834.826046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.826114:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444086656 00000100:00100000:3.0:1785219834.826123:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444086656 00000100:00100000:3.0:1785219834.826175:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:3.0:1785219834.826183:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:9689:x1871938444086656:12345-192.168.203.31@tcp:101:rm.0 00010000:00010000:3.0:1785219834.826222:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219834.826247:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f307 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826324:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826339:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826352:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826397:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826406:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826413:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826696:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078c95a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826707:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078c95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826714:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078c95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219834.826743:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1785219834.826755:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219834.826779:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078c95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826791:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078c95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826800:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826807:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826813:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826819:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.826823:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826831:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826843:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219834.826847:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.826852:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826858:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078c94c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826870:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826886:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826892:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826897:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.826901:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826907:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826914:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff9cf356788600) 00010000:00010000:3.0:1785219834.826917:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.826919:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826925:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826954:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078c945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f307 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826968:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078c95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f307 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.826975:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf345fcd700) 00010000:00010000:3.0:1785219834.826978:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219834.826984:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07c00, rc 0) 00000100:00100000:3.0:1785219834.827052:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:9689:x1871938444086656:12345-192.168.203.31@tcp:101:rm.0 Request processed in 868us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219834.827061:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1785219834.832646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219834.832800:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444086912 00000100:00100000:2.0:1785219834.832811:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444086912 00000100:00100000:2.0:1785219834.832874:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1785219834.832884:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:9689:x1871938444086912:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:2.0:1785219834.832944:0:8055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1785219834.832975:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078c95a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f307 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833016:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078c906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2eb expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833030:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf345fcd700) 00010000:00010000:2.0:1785219834.833057:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078c91b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2f2 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833067:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:2.0:1785219834.833071:0:8055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219834.833091:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833103:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833112:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833128:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833135:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833141:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833316:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833334:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.833341:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785219834.836011:0:8055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1785219834.836122:0:8055:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327688757442ns, next at 328688753794ns, rc = 0 00010000:00010000:2.0:1785219834.836208:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836225:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836237:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836246:0:8055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836253:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836260:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836444:0:8055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785219834.836472:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836479:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836493:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836500:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cc600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219834.836504:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836513:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836537:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219834.836541:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785219834.836546:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836552:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c96f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836571:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836586:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836592:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836597:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219834.836600:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836618:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836627:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:2.0:1785219834.836629:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219834.836632:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.836638:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078c961 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219834.836648:0:8055:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d7f2a58 reply state 00000000d5a96eb7 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219834.836656:0:8055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785219834.836750:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:9689:x1871938444086912:12345-192.168.203.31@tcp:36:rm.0 Request processed in 3864us (4109us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1785219834.836759:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00010000:00010000:1.0:1785219834.839972:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219834.839985:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.839997:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cd600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219834.840002:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.840014:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.840032:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:1.0:1785219834.840035:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785219834.840041:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.840047:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cd600/0x8b38d407a078c976 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.840090:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219834.840090:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219834.840094:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219834.840097:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219834.840104:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.840112:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.840118:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.840123:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.840129:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.840139:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff9cf345fcdc00) 00010000:00010000:3.0:1785219834.840143:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.840146:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.840153:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078c968 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219834.842508:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.842620:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444087168 00000100:00100000:3.0:1785219834.842631:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444087168 00000100:00100000:3.0:1785219834.842692:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1785219834.842705:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:9689:x1871938444087168:12345-192.168.203.31@tcp:35:rm.0 00000100:00100000:3.0:1785219834.842981:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:9689:x1871938444087168:12345-192.168.203.31@tcp:35:rm.0 Request processed in 279us (482us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785219834.842989:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1785219834.845822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219834.845939:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444087424 00000100:00100000:3.0:1785219834.845949:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444087424 00000100:00100000:3.0:1785219834.846006:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1785219834.846017:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:9689:x1871938444087424:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1785219834.846163:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785219834.846191:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078c937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f300 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846225:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078c8d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2dd expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846238:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219834.846253:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078c896 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2cf expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846262:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd800) 00010000:00010000:3.0:1785219834.846268:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219834.846291:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846304:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846313:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846341:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846348:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.846355:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.847634:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.847647:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.847656:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219834.848791:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1785219834.848811:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848831:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848838:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848843:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cc600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219834.848848:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848855:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848869:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf345fcd700) 00010000:00010000:2.0:1785219834.848873:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785219834.848876:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848882:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3413cc600/0x8b38d407a078c98b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848906:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848912:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848917:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848921:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219834.848930:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848936:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848943:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788600) 00010000:00010000:2.0:1785219834.848945:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219834.848948:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219834.848953:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078c97d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219834.848966:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dac36818 reply state 000000002cfad480 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219834.848975:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785219834.849277:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:9689:x1871938444087424:12345-192.168.203.31@tcp:36:rm.0 Request processed in 3258us (3459us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1785219834.849296:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00010000:00010000:3.0:1785219834.852774:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.852792:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.852800:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.852806:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219834.852812:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.852820:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.852841:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf356788000) 00010000:00010000:3.0:1785219834.852844:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219834.852849:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219834.852854:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078c984 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219835.243917:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219835.820689:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465090688:0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.820735:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465090432:0@lo:400:kworker.0 00000100:00100000:2.0:1785219835.820770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219835.820817:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465090304:0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.820864:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219835.820914:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465090944:0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.820941:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219835.820973:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785219835.820979:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465090560:0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.821005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219835.821047:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090688 00000100:00100000:0.0:1785219835.821076:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090688 00000100:00100000:0.0:1785219835.821129:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090944 00000100:00100000:0.0:1785219835.821132:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090944 00000100:00100000:0.0:1785219835.821160:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785219835.821170:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465090688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.821235:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465090688:12345-0@lo:400:kworker.0 Request processed in 67us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219835.821243:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785219835.821263:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785219835.821270:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465090944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.821317:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465090944:12345-0@lo:400:kworker.0 Request processed in 47us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219835.821323:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785219835.821343:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090432 00000100:00100000:0.0:1785219835.821347:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090432 00000100:00100000:0.0:1785219835.821395:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090560 00000100:00100000:0.0:1785219835.821399:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090560 00000100:00100000:0.0:1785219835.821420:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1785219835.821426:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465090432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.821459:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465090432:12345-0@lo:400:kworker.0 Request processed in 32us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219835.821465:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1785219835.821479:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785219835.821485:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465090560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.821514:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465090560:12345-0@lo:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219835.821520:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1785219835.821549:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785219835.821554:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785219835.821557:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219835.821604:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465090560:0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.821617:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465090432:0@lo:400:kworker.0 00010000:00080000:0.0:1785219835.821631:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38114f480 x1871938465090944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219835.821641:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465090944:0@lo:400:kworker.0 00010000:00080000:2.0:1785219835.824389:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348a38e00 x1871938465090688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219835.824410:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465090688:0@lo:400:kworker.0 00000100:00100000:1.0:1785219835.824815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219835.824896:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465090816:0@lo:400:kworker.0 00000100:00100000:1.0:1785219835.824939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219835.825388:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090816 00000100:00100000:2.0:1785219835.825396:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090816 00000100:00100000:2.0:1785219835.825456:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785219835.825464:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465090816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219835.825535:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465090816:12345-0@lo:400:kworker.0 Request processed in 71us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219835.825543:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1785219835.826009:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219835.826185:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465090816:0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.830645:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465090304 00000100:00100000:0.0:1785219835.830662:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465090304 00000100:00100000:3.0:1785219835.834282:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1785219835.834296:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465090304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219835.834453:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465090304:0@lo:400:kworker.0 00000100:00100000:3.0:1785219835.834862:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465090304:12345-0@lo:400:kworker.0 Request processed in 567us (10046us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219835.834872:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1785219835.924468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219835.924512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219835.924542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219835.924543:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444087680 00000100:00100000:3.0:1785219835.924554:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444087680 00000100:00100000:0.0:1785219835.924581:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219835.924600:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444087936 00000100:00100000:3.0:1785219835.924604:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444087936 00000100:00100000:3.0:1785219835.924642:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1785219835.924652:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:2362:x1871938444087680:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219835.924741:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:2362:x1871938444087680:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 91us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219835.924750:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1785219835.924769:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1785219835.924776:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444087936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219835.924785:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444087808 00000100:00100000:0.0:1785219835.924791:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444087808 00000100:00100000:3.0:1785219835.924805:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444087936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219835.924812:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:0.0:1785219835.924825:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00080000:3.0:1785219835.924835:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219835.924836:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2362:x1871938444087808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219835.924870:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2362:x1871938444087808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219835.924875:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:0.0:1785219835.924894:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444087552 00000100:00100000:0.0:1785219835.924897:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444087552 00000100:00100000:0.0:1785219835.924929:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 245 00000100:00100000:0.0:1785219835.924936:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444087552:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219835.924975:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444087552:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219835.924982:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 245 00010000:00010000:0.0:1785219836.270184:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219836.332064:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785219836.332089:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465091072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219836.332163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219836.332289:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465091072 00000100:00100000:0.0:1785219836.332299:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465091072 00000100:00100000:0.0:1785219836.332351:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1785219836.332381:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465091072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785219836.332421:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219836.332483:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465091072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219836.332491:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1785219836.332788:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38114c000 x1871938465091072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219836.332807:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465091072:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785219837.291862:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219838.320516:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785219838.379843:0:6630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331232476313ns, next at 332232473876ns, rc = 0 00000100:00100000:0.0:1785219838.379898:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219838.379919:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465091200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219838.379990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219838.380127:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465091200 00000100:00100000:1.0:1785219838.380134:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465091200 00000100:00100000:1.0:1785219838.380634:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785219838.380644:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465091200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219838.380678:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219838.380735:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465091200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219838.380742:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1785219838.380783:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3506c5880 x1871938465091200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219838.380802:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465091200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785219838.381041:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1785219839.160015:0:11462:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1785219839.339587:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785219840.005909:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000004:00080000:3.0:1785219840.005940:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1785219840.005960:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1785219840.005964:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1785219840.018142:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465091328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785219840.018240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219840.018301:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465091328 00000100:00100000:0.0:1785219840.018309:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465091328 00000100:00100000:0.0:1785219840.018411:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1785219840.018413:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219840.018423:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465091328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1785219840.018457:0:6586:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1785219840.018492:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a684afa, atime: 0x6a684afa, ctime: 0x6a684afa, blocks: 0x1 00010000:00010000:0.0:1785219840.018634:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.018649:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1785219840.018659:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219840.018666:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.018682:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.018693:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.018701:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.018725:0:6586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785219840.019248:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465091328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 825us (1005us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1785219840.019257:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1785219840.019312:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf38114ca80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1785219840.019318:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465091328:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1785219840.019404:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219840.019417:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.019427:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219840.019431:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.019441:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.019468:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.019474:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60ebd31/0x8b38d407a078c992 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.019493:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219840.019495:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219840.019497:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1785219840.069891:0:11511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe06c15f50 20000000:00000080:2.0:1785219840.069908:0:11511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf348a36c00 uarg=0000000000000000 20000000:01000000:2.0:1785219840.069943:0:11511:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1785219840.069949:0:11511:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1785219840.069954:0:11511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1785219840.073344:0:11512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1785219840.075035:0:11511:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1785219840.095938:0:11511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1785219840.095993:0:11511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1785219840.097899:0:11511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1785219840.097940:0:11511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1785219840.097961:0:11511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.097979:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c834 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098002:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c842 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098009:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c850 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098018:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098025:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098031:0:11511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098071:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098086:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 12 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.098100:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091456:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219840.098321:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098331:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 12 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.098340:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091584:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219840.098409:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c850 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098417:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c850 expref: 18 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.098437:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091712:0@lo:104: 00000100:00100000:1.0:1785219840.098478:0:11511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785219840.098597:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c842 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098605:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c842 expref: 18 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.098613:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091840:0@lo:104: 00000100:00100000:1.0:1785219840.098633:0:11511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785219840.098680:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078c834 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.098689:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078c834 expref: 18 pid: 5785 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.098699:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091968:0@lo:104: 00000100:00100000:3.0:1785219840.098705:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465091712 00000100:00100000:3.0:1785219840.098713:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465091712 00000100:00100000:1.0:1785219840.098725:0:11511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219840.098742:0:11511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3810af180 going to sleep for 11 seconds 00000100:00100000:3.0:1785219840.098762:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785219840.098784:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465091840 00000100:00100000:3.0:1785219840.098787:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465091840 00000100:00100000:3.0:1785219840.098801:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465091968 00000100:00100000:3.0:1785219840.098804:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465091968 00000100:00100000:2.0:1785219840.098820:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785219840.098831:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785219840.098834:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+5:11511:x1871938465091712:12345-0@lo:104: 00000100:00100000:3.0:1785219840.098845:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:11511:x1871938465091840:12345-0@lo:104: 00010000:00010000:2.0:1785219840.098847:0:6602:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.098857:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.098918:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785219840.098925:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+5:11511:x1871938465091712:12345-0@lo:104: Request processed in 96us (447us total) trans 0 rc 0/0 00010000:00010000:3.0:1785219840.098927:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785219840.098936:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785219840.098938:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+5:11511:x1871938465091840:12345-0@lo:104: Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219840.098947:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785219840.098961:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785219840.098970:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2461fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+3:11511:x1871938465091968:12345-0@lo:104: 00010000:00010000:3.0:1785219840.098974:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785219840.098977:0:6602:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.098982:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.099004:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1200 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:3.0:1785219840.099009:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.099009:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785219840.099019:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2461fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+3:11511:x1871938465091968:12345-0@lo:104: Request processed in 50us (294us total) trans 0 rc 0/0 00010000:00010000:3.0:1785219840.099024:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785219840.099037:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219840.099042:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 10000000:01000000:3.0:1785219840.099049:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785219840.099079:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.099086:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785219840.099145:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465092096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219840.099150:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091712:0@lo:104: 00000100:00100000:1.0:1785219840.099160:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091840:0@lo:104: 00000100:00100000:1.0:1785219840.099180:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091968:0@lo:104: 00000100:00100000:2.0:1785219840.099190:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785219840.099232:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.099240:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1200/0x8b38d407a078c850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c857 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.099252:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785219840.099256:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.099261:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0c00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:3.0:1785219840.099264:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.099280:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785219840.099286:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219840.099291:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785219840.099308:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.099313:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1785219840.099340:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092096 00000100:00100000:1.0:1785219840.099350:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092096 00010000:00010000:1.0:1785219840.099392:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c850 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.099415:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785219840.099422:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465092096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219840.099432:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219840.099437:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c850 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.099445:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c850 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.099458:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f80e00/0x8b38d407a078c857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c850 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.099471:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219840.100782:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465092224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785219840.101116:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785219840.101176:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1785219840.101199:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092224 00000100:00100000:0.0:1785219840.101581:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092224 00010000:00010000:3.0:1785219840.101593:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.101607:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078c842 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.101613:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c842 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.101622:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219840.101625:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219840.101627:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219840.101822:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1785219840.101830:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465092224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785219840.101845:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219840.101850:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c842 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.101859:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c842 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.101875:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3489b1a00/0x8b38d407a078c849 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c842 expref: 19 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.101889:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219840.101944:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:3309:x1871938465092224:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219840.101952:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1785219840.101984:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465092224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219840.102615:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:3308:x1871938465092096:12345-0@lo:103:ldlm_bl.0 Request processed in 3191us (3424us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219840.102625:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785219840.103905:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465092096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219840.104532:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219840.104606:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219840.104610:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219840.104789:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.105273:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81e00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219840.105278:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.105289:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219840.105332:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219840.105339:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785219840.105415:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.105423:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219840.105448:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.105457:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f81e00/0x8b38d407a078c834 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078c83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219840.105470:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465092352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219840.105476:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219840.105479:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219840.105483:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219840.105551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219840.106441:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092352 00000100:00100000:1.0:1785219840.106450:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092352 00010000:00010000:1.0:1785219840.106483:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c834 expref: 17 pid: 5785 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.106522:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785219840.106530:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6828c272-120a-44fd-b7c4-fcf074b0473f+17:3306:x1871938465092352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219840.106547:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219840.106552:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078c834 expref: 17 pid: 5785 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.106563:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078c834 expref: 17 pid: 5785 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.106590:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078c83b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078c834 expref: 17 pid: 5785 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219840.106606:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219840.106678:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3306:x1871938465092352:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219840.106686:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785219840.106705:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465092352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785219840.107095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219840.107154:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088064 00000100:00100000:2.0:1785219840.107159:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088064 00010000:00010000:2.0:1785219840.107189:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 13 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219840.107222:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1785219840.107229:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444088064:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219840.107237:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219840.107242:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 13 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.107251:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 13 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.107263:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219840.108070:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444088064:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 835us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219840.108080:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1785219840.109862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:1.0:1785219840.109923:0:11511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c85e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2ba expref: 12 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219840.109942:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091584:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219840.109964:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1871938465091456:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219840.110000:0:11511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219840.110034:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088192 00000100:00100000:2.0:1785219840.110042:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088192 00010000:00010000:2.0:1785219840.110073:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 12 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219840.110109:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1785219840.110118:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:2361:x1871938444088192:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219840.110132:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219840.110138:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 12 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110149:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 12 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110177:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06000/0x8b38d407a078c865 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f2c1 expref: 12 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110191:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110199:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110226:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110234:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110241:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110264:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110271:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219840.110275:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110284:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110302:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219840.110312:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219840.110356:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2361:x1871938444088192:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 240us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219840.110393:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00010000:00010000:0.0:1785219840.110776:0:11511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.110785:0:11511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219840.110792:0:11511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf348a29600/0x8b38d407a078c999 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219840.364692:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219840.939907:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465092480:0@lo:400:kworker.0 00000100:00100000:3.0:1785219840.939944:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465092608:0@lo:400:kworker.0 00000100:00100000:3.0:1785219840.940000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219840.940001:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219840.940064:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465092992:0@lo:400:kworker.0 00000100:00100000:1.0:1785219840.940092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219840.940116:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219840.940117:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092480 00000100:00100000:1.0:1785219840.940123:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465092864:0@lo:400:kworker.0 00000100:00100000:0.0:1785219840.940127:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092480 00000100:00100000:1.0:1785219840.940152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219840.940184:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465092736:0@lo:400:kworker.0 00000100:00100000:0.0:1785219840.940194:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1785219840.940201:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092608 00000100:00100000:1.0:1785219840.940206:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092608 00000100:00100000:0.0:1785219840.940207:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3307:x1871938465092480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219840.940225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219840.940250:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092992 00000100:00100000:1.0:1785219840.940254:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092992 00000100:00100000:2.0:1785219840.940269:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092736 00000100:00100000:2.0:1785219840.940275:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092736 00000100:00100000:0.0:1785219840.940290:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3307:x1871938465092480:12345-0@lo:400:kworker.0 Request processed in 86us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219840.940300:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1785219840.940306:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1785219840.940313:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1785219840.940318:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465092608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219840.940328:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465092992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219840.940387:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465092608:12345-0@lo:400:kworker.0 Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219840.940390:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465092864 00000100:00100000:1.0:1785219840.940396:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785219840.940397:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465092864 00000100:00100000:2.0:1785219840.940407:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465092992:12345-0@lo:400:kworker.0 Request processed in 82us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219840.940416:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1785219840.940441:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785219840.940449:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465092864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219840.940481:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465092864:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219840.940506:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785219840.940547:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465092864:0@lo:400:kworker.0 00000100:00100000:0.0:1785219840.940558:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465092992:0@lo:400:kworker.0 00000100:00100000:0.0:1785219840.940567:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465092480:0@lo:400:kworker.0 00000100:00080000:0.0:1785219840.940595:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219840.942247:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785219840.942272:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465092736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219840.942360:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465092736:12345-0@lo:400:kworker.0 Request processed in 100us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219840.942380:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785219840.942465:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465092736:0@lo:400:kworker.0 00000100:00100000:3.0:1785219840.944017:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465092608:0@lo:400:kworker.0 00000100:00100000:3.0:1785219840.944032:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465093120:0@lo:400:kworker.0 00000100:00100000:3.0:1785219840.944107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219840.944315:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465093120 00000100:00100000:1.0:1785219840.944323:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465093120 00000100:00100000:1.0:1785219840.944402:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785219840.944411:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465093120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1785219840.944501:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785219840.944634:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465093120:12345-0@lo:400:kworker.0 Request processed in 223us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219840.944644:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1785219840.944826:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348931500 x1871938465093120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219840.944837:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465093120:0@lo:400:kworker.0 00000100:00100000:0.0:1785219841.041101:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219841.041145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219841.041201:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219841.041226:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088448 00000100:00100000:2.0:1785219841.041249:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088448 00000100:00100000:0.0:1785219841.041271:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219841.041315:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088576 00000100:00100000:2.0:1785219841.041318:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088704 00000100:00100000:0.0:1785219841.041321:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088576 00000100:00100000:2.0:1785219841.041324:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088704 00000100:00100000:2.0:1785219841.041358:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:3.0:1785219841.041395:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088320 00000100:00100000:3.0:1785219841.041401:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088320 00000100:00100000:2.0:1785219841.041403:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444088448:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219841.041405:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1785219841.041420:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444088576:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219841.041437:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:3.0:1785219841.041446:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2360:x1871938444088320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219841.041718:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444088576:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 302us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219841.041726:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1785219841.041862:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1785219841.041871:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444088704:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219841.046944:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444088448:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 5531us (5839us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.046959:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00080000:2.0:1785219841.047003:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785219841.047010:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219841.053023:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2360:x1871938444088320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 11568us (11812us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.053037:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 247 00000100:00100000:1.0:1785219841.057745:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444088704:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 15863us (16586us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219841.057760:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:0.0:1785219841.360948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219841.366894:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088832 00000100:00100000:3.0:1785219841.366911:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088832 00000100:00100000:3.0:1785219841.366978:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:3.0:1785219841.366989:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:5576:x1871938444088832:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219841.367006:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219841.367024:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06400/0x8b38d407a078c9a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f30e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.367053:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06400/0x8b38d407a078c9a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f30e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.367062:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06400/0x8b38d407a078c9a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f30e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.367071:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06400, rc 0) 00000100:00100000:3.0:1785219841.367146:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444088832:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 159us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.367162:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 248 00000100:00100000:0.0:1785219841.369477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219841.369782:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444088960 00000100:00100000:3.0:1785219841.369791:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444088960 00000100:00100000:3.0:1785219841.369848:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:3.0:1785219841.369859:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444088960:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.370164:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444088960:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 298us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.370172:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 249 00000100:00100000:0.0:1785219841.374149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219841.374775:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089088 00000100:00100000:2.0:1785219841.374786:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089088 00000100:00100000:2.0:1785219841.374896:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 250 00000100:00100000:2.0:1785219841.374907:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444089088:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219841.375132:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444089088:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 227us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.375141:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 250 00010000:00010000:2.0:1785219841.387514:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219841.387670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219841.387787:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089216 00000100:00100000:0.0:1785219841.387797:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089216 00000100:00100000:0.0:1785219841.387844:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:0.0:1785219841.387853:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:9960:x1871938444089216:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785219841.388099:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:9960:x1871938444089216:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 246us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219841.388108:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 251 00000100:00100000:1.0:1785219841.392641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219841.393046:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089344 00000100:00100000:2.0:1785219841.393056:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089344 00000100:00100000:2.0:1785219841.393177:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:2.0:1785219841.393187:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:9960:x1871938444089344:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785219841.393500:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:9960:x1871938444089344:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 314us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.393509:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 252 00000100:00100000:0.0:1785219841.396526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219841.396827:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089472 00000100:00100000:3.0:1785219841.396837:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089472 00000100:00100000:3.0:1785219841.396896:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:3.0:1785219841.396907:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:5576:x1871938444089472:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219841.396926:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219841.396947:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c9a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f315 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.396977:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c9a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f315 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.396990:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c9a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f315 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.397001:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06c00, rc 0) 00000100:00100000:3.0:1785219841.397064:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444089472:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 160us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.397085:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 253 00000100:00100000:1.0:1785219841.400826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219841.400906:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089600 00000100:00100000:3.0:1785219841.400915:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089600 00000100:00100000:3.0:1785219841.400968:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:3.0:1785219841.400977:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444089600:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.401455:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444089600:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 478us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.401464:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 254 00000100:00100000:1.0:1785219841.405933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219841.406079:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089728 00000100:00100000:0.0:1785219841.406089:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089728 00000100:00100000:0.0:1785219841.406218:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:0.0:1785219841.406230:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444089728:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219841.407091:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:5576:x1871938444089728:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 858us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219841.407103:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 255 00000100:00100000:1.0:1785219841.418121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219841.418788:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089856 00000100:00100000:3.0:1785219841.418798:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089856 00000100:00100000:3.0:1785219841.418856:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00100000:3.0:1785219841.418866:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:9963:x1871938444089856:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785219841.421193:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:9963:x1871938444089856:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 2317us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.421209:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 256 00000100:00100000:0.0:1785219841.431869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219841.431955:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444089984 00000100:00100000:1.0:1785219841.431965:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444089984 00000100:00100000:1.0:1785219841.432073:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:1.0:1785219841.432084:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:9963:x1871938444089984:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785219841.432417:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:9963:x1871938444089984:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 322us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219841.432426:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 257 00000100:00100000:2.0:1785219841.452530:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465093248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219841.452625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.453677:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465093248 00000100:00100000:3.0:1785219841.453687:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465093248 00000100:00100000:3.0:1785219841.453753:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1785219841.453764:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465093248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219841.453803:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219841.456375:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465093248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2590us (3727us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.456389:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1785219841.457028:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38114f100 x1871938465093248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219841.457053:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465093248:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1785219841.515561:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785219841.515569:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf37e4b1000 from 7 10000000:01000000:2.0:1785219841.515574:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785219841.515624:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.515637:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.515648:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219841.515680:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465093376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785219841.515749:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219841.515881:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf245350d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785219841.522945:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465093376 00000100:00100000:3.0:1785219841.522962:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465093376 00000100:00100000:2.0:1785219841.523181:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1785219841.523191:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+16:5790:x1871938465093376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219841.523207:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219841.523227:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c9b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c9ae expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.523255:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c9b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c9ae expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.523267:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c9b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c9ae expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.523284:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cc600, rc 0) 00000100:00100000:2.0:1785219841.523516:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465093376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 326us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.523523:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1785219841.524838:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465093376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219841.524865:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.524876:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219841.524961:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465093504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.525017:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.525285:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1785219841.525964:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465093504 00000100:00100000:0.0:1785219841.525974:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465093504 00000100:00100000:0.0:1785219841.526017:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1785219841.526025:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465093504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219841.526350:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465093504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219841.526380:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1785219841.526830:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465093504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.526879:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465093632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.526927:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.526965:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1785219841.529545:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465093632 00000100:00100000:0.0:1785219841.529560:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465093632 00000100:00100000:0.0:1785219841.529611:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1785219841.529621:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465093632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219841.529855:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465093632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219841.529863:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1785219841.530025:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465093632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.531099:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11525:1871938465093760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.531150:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.531202:0:11525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fd780 going to sleep for 11 seconds 00000100:00100000:1.0:1785219841.531269:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465093760 00000100:00100000:1.0:1785219841.531275:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465093760 00000100:00100000:1.0:1785219841.531315:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1785219841.531641:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:11525:x1871938465093760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219841.531881:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:11525:x1871938465093760:12345-0@lo:502:llog_process_th.0 Request processed in 558us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219841.531888:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1785219841.532000:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11525:1871938465093760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219841.532028:0:11525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219841.532038:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219841.532040:0:11525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785219841.532046:0:11525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf37e4b1000 00000020:00000080:3.0:1785219841.532048:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785219841.532175:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11525:1871938465093888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.532215:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.532247:0:11525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fd780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219841.532303:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465093888 00000100:00100000:0.0:1785219841.532308:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465093888 00000100:00100000:0.0:1785219841.532390:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1785219841.532400:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:11525:x1871938465093888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219841.532729:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+17:11525:x1871938465093888:12345-0@lo:502:llog_process_th.0 Request processed in 330us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219841.532737:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1785219841.532825:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11525:1871938465093888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785219841.532850:0:11525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219841.532855:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219841.532857:0:11525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1785219841.532862:0:11525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1785219841.533658:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1785219841.533679:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785219841.533688:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219841.533700:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219841.533710:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785219841.533712:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf349c7c000 from 7 10000000:01000000:0.0:1785219841.533715:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785219841.533746:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219841.533762:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219841.533773:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219841.533793:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785219841.533837:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219841.533872:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf38173f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219841.534048:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094016 00000100:00100000:2.0:1785219841.534055:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094016 00000100:00100000:2.0:1785219841.534097:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1785219841.534106:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+17:5790:x1871938465094016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219841.534116:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219841.534129:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c9c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c9bc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.534150:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c9c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c9bc expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.534171:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c9c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c9bc expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.534180:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81c00, rc 0) 00000100:00100000:2.0:1785219841.534306:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465094016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.534313:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1785219841.535038:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219841.535059:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.535070:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219841.535149:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.535192:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.535239:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785219841.538206:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094144 00000100:00100000:2.0:1785219841.538220:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094144 00000100:00100000:2.0:1785219841.538290:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1785219841.538300:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465094144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219841.538651:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465094144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.538659:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1785219841.541624:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.541683:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.541749:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.541789:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785219841.541911:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094272 00000100:00100000:2.0:1785219841.541918:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094272 00000100:00100000:2.0:1785219841.541970:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1785219841.541980:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465094272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219841.542178:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465094272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.542186:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1785219841.542453:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.543728:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11527:1871938465094400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.543791:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.543831:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219841.543882:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094400 00000100:00100000:1.0:1785219841.543888:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094400 00000100:00100000:1.0:1785219841.543926:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1785219841.543934:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:11527:x1871938465094400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219841.544140:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350782450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+18:11527:x1871938465094400:12345-0@lo:502:llog_process_th.0 Request processed in 207us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219841.544165:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1785219841.544294:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11527:1871938465094400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219841.544319:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219841.544328:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219841.544330:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785219841.544336:0:11527:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf349c7c000 00000020:00000080:3.0:1785219841.544344:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785219841.544624:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11527:1871938465094528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.544658:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.544679:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219841.545033:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094528 00000100:00100000:1.0:1785219841.545039:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094528 00000100:00100000:1.0:1785219841.545078:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1785219841.545085:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:11527:x1871938465094528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219841.545247:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:11527:x1871938465094528:12345-0@lo:502:llog_process_th.0 Request processed in 162us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219841.545254:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1785219841.545741:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11527:1871938465094528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219841.545767:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219841.545773:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219841.545775:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785219841.545779:0:11527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1785219841.545979:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1785219841.545997:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785219841.546007:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219841.546019:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219841.546042:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785219841.546045:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf3503a5000 from 7 10000000:01000000:1.0:1785219841.546048:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785219841.546076:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219841.546084:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219841.546094:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219841.546110:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785219841.546167:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219841.546200:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3507b60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219841.546996:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094656 00000100:00100000:2.0:1785219841.547004:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094656 00000100:00100000:2.0:1785219841.547053:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1785219841.547062:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:5790:x1871938465094656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219841.547075:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219841.547090:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c9d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078c9ca expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.547116:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078c9ca expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.547127:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c9d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078c9ca expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219841.547150:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81e00, rc 0) 00000100:00100000:2.0:1785219841.547215:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465094656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.547221:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1785219841.547316:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219841.547332:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.547341:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219841.547559:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.547591:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.547619:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fde40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219841.547659:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094784 00000100:00100000:2.0:1785219841.547663:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094784 00000100:00100000:2.0:1785219841.547694:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1785219841.547701:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465094784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785219841.547922:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465094784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219841.547929:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1785219841.548947:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.548992:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.549041:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.549078:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fde40 going to sleep for 11 seconds 00000100:00100000:3.0:1785219841.549095:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465094912 00000100:00100000:3.0:1785219841.549100:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465094912 00000100:00100000:3.0:1785219841.549132:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1785219841.549139:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465094912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.549311:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:5790:x1871938465094912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.549317:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1785219841.549358:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6828c272-120a-44fd-b7c4-fcf074b0473f:5790:1871938465094912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219841.549542:0:11529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11529:1871938465095040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.549575:0:11529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.549593:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095040 00000100:00100000:3.0:1785219841.549597:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095040 00000100:00100000:3.0:1785219841.549617:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1785219841.549624:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:11529:x1871938465095040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.549734:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:11529:x1871938465095040:12345-0@lo:502:llog_process_th.0 Request processed in 110us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.549741:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1785219841.549767:0:11529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fd480 going to sleep for 11 seconds 00000100:00100000:3.0:1785219841.549777:0:11529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11529:1871938465095040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219841.549793:0:11529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219841.549801:0:11529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219841.549803:0:11529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785219841.549809:0:11529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf3503a5000 00000020:00000080:3.0:1785219841.549811:0:11529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785219841.549869:0:11529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11529:1871938465095168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.549898:0:11529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219841.549915:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095168 00000100:00100000:3.0:1785219841.549918:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095168 00000100:00100000:3.0:1785219841.549936:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1785219841.549947:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:11529:x1871938465095168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219841.550038:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:11529:x1871938465095168:12345-0@lo:502:llog_process_th.0 Request processed in 91us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219841.550044:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1785219841.550068:0:11529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4fd480 going to sleep for 11 seconds 00000100:00100000:3.0:1785219841.550078:0:11529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348932680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6828c272-120a-44fd-b7c4-fcf074b0473f:11529:1871938465095168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785219841.550092:0:11529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219841.550095:0:11529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219841.550097:0:11529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785219841.550100:0:11529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1785219841.550139:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1785219841.550167:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219841.550175:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219841.550184:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785219841.573018:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785219842.414939:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785219842.604521:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785219843.438043:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219843.501417:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219843.501455:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465095296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219843.501550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219843.501747:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095296 00000100:00100000:1.0:1785219843.501758:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095296 00000100:00100000:1.0:1785219843.501844:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785219843.501856:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465095296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219843.501906:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219843.501962:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465095296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219843.501970:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785219843.502129:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465095296:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785219843.502207:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785219844.459609:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785219845.122062:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1785219845.483668:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219846.060167:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465095424:0@lo:400:kworker.0 00000100:00100000:0.0:1785219846.060251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219846.060304:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095424 00000100:00100000:3.0:1785219846.060312:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095424 00000100:00100000:3.0:1785219846.060393:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1785219846.060404:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465095424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219846.060452:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465095808:0@lo:400:kworker.0 00000100:00100000:2.0:1785219846.060498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219846.060544:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095808 00000100:00100000:2.0:1785219846.060548:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095808 00000100:00100000:1.0:1785219846.060558:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465095552:0@lo:400:kworker.0 00000100:00100000:2.0:1785219846.060596:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785219846.060597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219846.060608:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465095808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219846.060625:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465096064:0@lo:400:kworker.0 00000100:00100000:1.0:1785219846.060657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219846.060667:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465095808:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219846.060677:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785219846.060678:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785219846.060686:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465095680:0@lo:400:kworker.0 00000100:00100000:2.0:1785219846.060696:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096064 00000100:00100000:2.0:1785219846.060700:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096064 00000100:00100000:1.0:1785219846.060710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219846.060748:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785219846.060755:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465096064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219846.060762:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095552 00000100:00100000:1.0:1785219846.060767:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095552 00000100:00100000:2.0:1785219846.060798:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465096064:12345-0@lo:400:kworker.0 Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219846.060804:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785219846.060815:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095680 00000100:00100000:1.0:1785219846.060820:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095680 00000100:00080000:2.0:1785219846.060826:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219846.060834:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785219846.060837:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219846.060849:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1785219846.060860:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1785219846.060860:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465095552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219846.060873:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465095680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219846.060889:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465095424:12345-0@lo:400:kworker.0 Request processed in 488us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219846.060897:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1785219846.060911:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465095552:12345-0@lo:400:kworker.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219846.060916:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465095680:12345-0@lo:400:kworker.0 Request processed in 45us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219846.060928:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1785219846.060934:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1785219846.060958:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1785219846.060964:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf38114ca80, transno 4294967300 00000100:00100000:3.0:1785219846.060986:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465095808:0@lo:400:kworker.0 00000100:00100000:1.0:1785219846.060994:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465095680:0@lo:400:kworker.0 00000100:00100000:3.0:1785219846.061004:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219846.061008:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465095552:0@lo:400:kworker.0 00000100:00100000:3.0:1785219846.061015:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465095936:0@lo:400:kworker.0 00010000:00080000:1.0:1785219846.061022:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38116f480 x1871938465096064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219846.061032:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465096064:0@lo:400:kworker.0 00000100:00100000:3.0:1785219846.061045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219846.062699:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465095936 00000100:00100000:2.0:1785219846.062710:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465095936 00000100:00100000:2.0:1785219846.062834:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1785219846.062844:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465095936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219846.062918:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465095936:12345-0@lo:400:kworker.0 Request processed in 75us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219846.062925:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1785219846.062969:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465095936:0@lo:400:kworker.0 00000100:00100000:0.0:1785219846.064062:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465095424:0@lo:400:kworker.0 00000100:00080000:3.0:1785219846.066160:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219846.163879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219846.163933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219846.163966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219846.163998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219846.164088:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444090368 00000100:00100000:2.0:1785219846.164094:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444090112 00000100:00100000:2.0:1785219846.164108:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444090112 00000100:00100000:0.0:1785219846.164109:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444090368 00000100:00100000:2.0:1785219846.164194:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:2.0:1785219846.164208:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444090112:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219846.164229:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1785219846.164242:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444090368:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219846.164286:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444090112:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219846.164310:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 274 00000100:00100000:0.0:1785219846.164330:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444090368:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219846.164342:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00080000:2.0:1785219846.164416:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219846.167186:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444090240 00000100:00100000:3.0:1785219846.167343:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444090240 00000100:00100000:3.0:1785219846.167698:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444090496 00000100:00100000:3.0:1785219846.167704:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444090496 00000100:00100000:3.0:1785219846.167746:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1785219846.167757:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444090240:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219846.167862:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444090240:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 107us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219846.167869:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1785219846.167890:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:3.0:1785219846.167896:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444090496:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219846.167922:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444090496:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219846.167928:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00080000:2.0:1785219846.168308:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785219846.507870:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219846.571762:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219846.571787:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465096192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219846.571874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219846.571931:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096192 00000100:00100000:3.0:1785219846.571939:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096192 00000100:00100000:3.0:1785219846.571994:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785219846.572004:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465096192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219846.572038:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219846.572092:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465096192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219846.572113:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1785219846.572203:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38114ca80 x1871938465096192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219846.572220:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465096192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785219847.532027:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219848.555589:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219848.623166:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465096320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219848.623238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219848.623400:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096320 00000100:00100000:1.0:1785219848.623411:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096320 00000100:00100000:1.0:1785219848.623476:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1785219848.623486:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465096320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219848.623522:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1785219848.623531:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219848.624163:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465096320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 677us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219848.624173:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785219848.630905:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465096320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785219849.580243:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219850.604506:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219851.180317:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465096704:0@lo:400:kworker.0 00000100:00100000:3.0:1785219851.180425:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219851.180531:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785219851.180539:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465096576:0@lo:400:kworker.0 00000100:00100000:3.0:1785219851.180564:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219851.180581:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465097088:0@lo:400:kworker.0 00000100:00100000:3.0:1785219851.180617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219851.180645:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096704 00000100:00100000:3.0:1785219851.180652:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096704 00000100:00100000:1.0:1785219851.180776:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465096448:0@lo:400:kworker.0 00000100:00100000:1.0:1785219851.180813:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219851.180838:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465096960:0@lo:400:kworker.0 00000100:00100000:1.0:1785219851.180878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219851.180896:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785219851.180919:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465096832:0@lo:400:kworker.0 00000100:00100000:1.0:1785219851.180944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219851.180988:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097088 00000100:00100000:2.0:1785219851.180994:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097088 00000100:00100000:1.0:1785219851.181000:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096448 00000100:00100000:1.0:1785219851.181005:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096448 00000100:00100000:1.0:1785219851.181045:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1785219851.181052:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465096448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219851.181121:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465096448:12345-0@lo:400:kworker.0 Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219851.181128:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1785219851.181166:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096576 00000100:00100000:1.0:1785219851.181169:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096576 00000100:00100000:1.0:1785219851.181189:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096960 00000100:00100000:1.0:1785219851.181192:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096960 00000100:00100000:0.0:1785219851.181247:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785219851.181256:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465096576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219851.181297:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465096576:12345-0@lo:400:kworker.0 Request processed in 42us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219851.181303:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785219851.181450:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465096448:0@lo:400:kworker.0 00000100:00100000:0.0:1785219851.181495:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465096832 00000100:00100000:0.0:1785219851.181498:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465096832 00000100:00100000:3.0:1785219851.181792:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1785219851.181800:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465096704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219851.181835:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465096704:12345-0@lo:400:kworker.0 Request processed in 36us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219851.181841:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1785219851.181874:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465096576:0@lo:400:kworker.0 00000100:00100000:3.0:1785219851.181885:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465096704:0@lo:400:kworker.0 00000100:00100000:2.0:1785219851.185967:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1785219851.185985:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465097088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219851.186028:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1785219851.186037:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465096960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219851.186137:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465096960:12345-0@lo:400:kworker.0 Request processed in 101us (5257us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219851.186143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1785219851.186196:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465096960:0@lo:400:kworker.0 00000100:00100000:2.0:1785219851.186380:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465097088:12345-0@lo:400:kworker.0 Request processed in 385us (5744us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219851.186388:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1785219851.186475:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf36dc02a00 x1871938465097088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219851.186488:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465097088:0@lo:400:kworker.0 00000100:00100000:0.0:1785219851.187048:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1785219851.187059:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465096832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219851.187128:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465096832:12345-0@lo:400:kworker.0 Request processed in 72us (6183us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219851.187136:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785219851.187163:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465096832:0@lo:400:kworker.0 00000100:00080000:3.0:1785219851.187836:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785219851.187843:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785219851.187847:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219851.287280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219851.287333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219851.287473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219851.287532:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444090624 00000100:00100000:2.0:1785219851.287762:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444090624 00000100:00100000:2.0:1785219851.287840:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:2.0:1785219851.287850:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444090624:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219851.287971:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444090624:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 122us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219851.287978:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 276 00000100:00100000:3.0:1785219851.289575:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444090752 00000100:00100000:3.0:1785219851.289594:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444090752 00000100:00100000:0.0:1785219851.289638:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091008 00000100:00100000:1.0:1785219851.289652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219851.289652:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091008 00000100:00100000:3.0:1785219851.289769:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1785219851.289781:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444090752:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219851.289851:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:0.0:1785219851.289865:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444091008:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219851.289890:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444090752:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 106us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219851.289900:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00080000:3.0:1785219851.289938:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219851.289941:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444091008:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 76us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219851.289954:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1785219851.290185:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444090880 00000100:00100000:2.0:1785219851.290190:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444090880 00000100:00100000:2.0:1785219851.290241:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1785219851.290248:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444090880:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219851.290281:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444090880:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219851.290288:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00080000:0.0:1785219851.290356:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785219851.627961:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219851.691952:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465097216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785219851.692063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219851.692180:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097216 00000100:00100000:1.0:1785219851.692191:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097216 00000100:00100000:1.0:1785219851.692252:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785219851.692263:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465097216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219851.692316:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219851.692410:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465097216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219851.692419:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1785219851.692471:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38114ce00 x1871938465097216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219851.692492:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465097216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785219852.651999:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785219852.844329:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785219853.678578:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219853.741678:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785219853.741712:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465097344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219853.741812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219853.742038:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097344 00000100:00100000:0.0:1785219853.742049:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097344 00000100:00100000:0.0:1785219853.742133:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1785219853.742145:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465097344:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785219853.742191:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1785219853.742195:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219853.742295:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465097344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219853.742304:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785219853.742462:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465097344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785219854.699776:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219855.723975:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219856.300842:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465097856:0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.300940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219856.301034:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785219856.301041:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465097472:0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.301239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219856.301269:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465097984:0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.301297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219856.301338:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097472 00000100:00100000:0.0:1785219856.301347:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097472 00000100:00100000:3.0:1785219856.301468:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097856 00000100:00100000:3.0:1785219856.301473:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097856 00000100:00100000:3.0:1785219856.301541:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785219856.301552:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465097856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219856.301564:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465097600:0@lo:400:kworker.0 00000100:00100000:2.0:1785219856.301598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219856.301618:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465097856:12345-0@lo:400:kworker.0 Request processed in 68us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219856.301621:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465098112:0@lo:400:kworker.0 00000100:00100000:3.0:1785219856.301625:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785219856.301642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219856.301660:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785219856.301662:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465098112 00000100:00100000:3.0:1785219856.301666:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465098112 00000100:00100000:2.0:1785219856.301667:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465097728:0@lo:400:kworker.0 00000100:00100000:2.0:1785219856.301689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219856.301691:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785219856.301697:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465098112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219856.301738:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465098112:12345-0@lo:400:kworker.0 Request processed in 40us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219856.301745:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785219856.301750:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097984 00000100:00100000:2.0:1785219856.301754:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097984 00010000:00080000:3.0:1785219856.301789:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348a3ed80 x1871938465098112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219856.301805:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465098112:0@lo:400:kworker.0 00000100:00100000:3.0:1785219856.301861:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465097856:0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.301955:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1785219856.301964:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3306:x1871938465097472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.302007:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3306:x1871938465097472:12345-0@lo:400:kworker.0 Request processed in 45us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219856.302014:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1785219856.302245:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097600 00000100:00100000:0.0:1785219856.302250:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097600 00000100:00080000:1.0:1785219856.302329:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785219856.302337:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785219856.302339:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219856.302352:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465097728 00000100:00100000:1.0:1785219856.302357:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465097728 00000100:00080000:3.0:1785219856.302577:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219856.302619:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465097472:0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.303727:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1785219856.303748:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465097984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.303865:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465097984:12345-0@lo:400:kworker.0 Request processed in 127us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219856.303873:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1785219856.303896:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1785219856.303904:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465097600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.303961:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465097600:12345-0@lo:400:kworker.0 Request processed in 58us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219856.303966:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1785219856.304021:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465097600:0@lo:400:kworker.0 00000100:00100000:0.0:1785219856.304075:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465097984:0@lo:400:kworker.0 00000100:00100000:2.0:1785219856.309068:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1785219856.311274:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465097728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219856.311444:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465097728:12345-0@lo:400:kworker.0 Request processed in 205us (9752us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219856.311455:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1785219856.311571:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465097728:0@lo:400:kworker.0 00000100:00100000:2.0:1785219856.407751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219856.407814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219856.408163:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091264 00000100:00100000:3.0:1785219856.408176:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091264 00000100:00100000:3.0:1785219856.408278:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1785219856.408291:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444091264:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219856.408442:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444091264:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 154us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219856.408451:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00080000:1.0:1785219856.409151:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219856.409286:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091136 00000100:00100000:0.0:1785219856.409294:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091136 00000100:00100000:0.0:1785219856.409348:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 278 00000100:00100000:0.0:1785219856.409357:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444091136:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219856.409436:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444091136:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219856.409443:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 278 00000100:00100000:3.0:1785219856.422663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219856.422868:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091392 00000100:00100000:0.0:1785219856.422882:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091392 00000100:00100000:3.0:1785219856.422997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219856.423274:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091520 00000100:00100000:2.0:1785219856.423300:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091520 00000100:00100000:2.0:1785219856.423495:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:2.0:1785219856.423509:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444091520:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219856.423619:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444091520:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 113us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219856.423628:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00080000:1.0:1785219856.426944:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785219856.426962:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219856.428582:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1785219856.428604:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2358:x1871938444091392:12345-192.168.203.31@tcp:9:kworker.0 00000020:00000080:0.0:1785219856.428648:0:8158:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c90d 00000100:00080000:0.0:1785219856.428659:0:8158:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785219856.428746:0:8158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1785219856.430724:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219856.434647:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+2:2358:x1871938444091392:12345-192.168.203.31@tcp:9:kworker.0 Request processed in 6039us (12275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219856.434663:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:1.0:1785219856.747700:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219856.812314:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465098240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785219856.812456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219856.812570:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465098240 00000100:00100000:2.0:1785219856.812583:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465098240 00000100:00100000:2.0:1785219856.813514:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785219856.813541:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465098240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785219856.813596:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219856.813680:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465098240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219856.813688:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1785219856.813851:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38114c000 x1871938465098240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219856.813876:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465098240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785219857.775167:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219858.795597:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219858.860837:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785219858.860869:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219858.860966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219858.861326:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465098368 00000100:00100000:3.0:1785219858.861338:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465098368 00000100:00100000:3.0:1785219858.861455:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785219858.861466:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465098368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785219858.861512:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219858.861584:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465098368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219858.861592:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1785219858.861998:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219858.862057:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465098368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785219859.820073:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785219860.464728:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:1.0:1785219860.464742:0:6614:0:(genops.c:906:class_export_put()) final put ffff9cf2462f4800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:3.0:1785219860.464816:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf2462f4800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb for lustre-OST0000 00000020:00000080:3.0:1785219860.464880:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf2462f5800 for lustre-OST0000 00010000:00010000:0.0:1785219860.844666:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219861.421192:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465098496:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219861.421318:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465099008:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219861.421417:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785219861.421422:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465098880:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219861.421488:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465098624:0@lo:400:kworker.0 00000100:00100000:0.0:1785219861.421488:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099008 00000100:00100000:0.0:1785219861.421497:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099008 00000100:00100000:2.0:1785219861.421516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219861.421535:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465099136:0@lo:400:kworker.0 00000100:00100000:0.0:1785219861.421555:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465098624 00000100:00100000:2.0:1785219861.421556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219861.421560:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465098624 00000100:00100000:2.0:1785219861.421577:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219861.421585:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465098752:0@lo:400:kworker.0 00000100:00100000:0.0:1785219861.421589:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1785219861.421599:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465099008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219861.421633:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465098496 00000100:00100000:2.0:1785219861.421637:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465098496 00000100:00100000:0.0:1785219861.421659:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465099008:12345-0@lo:400:kworker.0 Request processed in 60us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219861.421667:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1785219861.421671:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1785219861.421680:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465098496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219861.421689:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465098752 00000100:00100000:0.0:1785219861.421694:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465098752 00000100:00100000:0.0:1785219861.421714:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1785219861.421720:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465098624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421734:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465098496:12345-0@lo:400:kworker.0 Request processed in 54us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219861.421741:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1785219861.421759:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465098624:12345-0@lo:400:kworker.0 Request processed in 38us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219861.421766:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1785219861.421775:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465098880 00000100:00100000:2.0:1785219861.421780:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465098880 00000100:00100000:0.0:1785219861.421784:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1785219861.421793:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465098752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421810:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099136 00000100:00100000:2.0:1785219861.421815:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099136 00000100:00100000:0.0:1785219861.421824:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465098752:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219861.421831:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1785219861.421839:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785219861.421847:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465098880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421877:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465098880:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219861.421883:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785219861.421893:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785219861.421897:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465099136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.421917:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465099136:12345-0@lo:400:kworker.0 Request processed in 19us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219861.421930:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1785219861.421944:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219861.421947:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785219861.421950:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219861.421993:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465098752:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.422005:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465098624:0@lo:400:kworker.0 00010000:00080000:2.0:1785219861.422031:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf3488f3800 x1871938465099136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219861.422041:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465099136:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.422082:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465098880:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.422089:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465098496:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.422100:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465099008:0@lo:400:kworker.0 00000100:00100000:2.0:1785219861.525998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219861.526051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219861.526058:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091648 00000100:00100000:0.0:1785219861.526070:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091648 00000100:00100000:2.0:1785219861.526121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219861.526143:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:0.0:1785219861.526545:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444091648:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219861.527093:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444091648:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 939us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219861.527113:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 280 00000100:00100000:1.0:1785219861.532889:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091904 00000100:00100000:1.0:1785219861.532907:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091904 00000100:00080000:2.0:1785219861.532954:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219861.533499:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444091776 00000100:00100000:1.0:1785219861.533505:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444091776 00000100:00100000:1.0:1785219861.533613:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1785219861.533623:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444091904:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219861.533774:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444091904:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 152us (7722us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219861.533781:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1785219861.533798:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1785219861.533804:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444091776:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219861.533828:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444091776:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (7707us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219861.533834:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00080000:1.0:1785219861.533852:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785219861.869102:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219861.934807:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465099264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219861.935669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219861.935720:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099264 00000100:00100000:3.0:1785219861.935741:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099264 00000100:00100000:3.0:1785219861.935801:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1785219861.935811:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465099264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219861.935851:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219861.935917:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465099264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219861.935924:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1785219861.936201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38114c000 x1871938465099264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219861.936221:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465099264:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1785219862.060470:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785219862.892690:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219863.919573:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785219863.971995:0:11696:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:24:22 (1785219862) 00000100:00100000:1.0:1785219863.986607:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785219863.986629:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465099392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219863.986701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219863.986765:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099392 00000100:00100000:1.0:1785219863.986772:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099392 00000100:00100000:1.0:1785219863.986830:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785219863.986839:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465099392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219863.986873:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219863.986917:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465099392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219863.986924:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1785219863.986944:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219863.986978:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465099392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785219864.939574:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219865.716298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219865.716466:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444092032 00000100:00100000:1.0:1785219865.716476:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444092032 00000100:00100000:1.0:1785219865.716675:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:1.0:1785219865.716687:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:10231:x1871938444092032:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785219865.716707:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219865.716774:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078c9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f31c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219865.716842:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078c9df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219865.716857:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078c9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219865.716870:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078c9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219865.717074:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1785219865.717078:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219865.717171:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078c9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219865.717331:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078c9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f31c expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219865.717486:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078c9df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f31c expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219865.717507:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9600) 00010000:00010000:1.0:1785219865.717511:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785219865.717514:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29800, rc 0) 00000100:00100000:1.0:1785219865.717581:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:10231:x1871938444092032:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 896us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219865.717589:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00080000:2.0:1785219865.718234:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219865.734727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219865.734821:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444092160 00000100:00100000:3.0:1785219865.734830:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444092160 00000100:00100000:3.0:1785219865.734929:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1785219865.734939:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:10232:x1871938444092160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219865.734958:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219865.734976:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078c9e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f323 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735046:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735059:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735079:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735101:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735124:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735131:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735545:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06e00/0x8b38d407a078c9fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735556:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06e00/0x8b38d407a078c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735563:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06e00/0x8b38d407a078c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219865.735663:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1785219865.735667:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219865.735749:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06e00/0x8b38d407a078c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735759:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735765:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735771:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735777:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219865.735781:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735794:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735806:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9600) 00010000:00010000:3.0:1785219865.735809:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219865.735813:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735819:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078c9ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735832:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735838:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735844:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735849:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219865.735851:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735857:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735863:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cf356788900) 00010000:00010000:3.0:1785219865.735865:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219865.735867:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735882:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078c9f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735914:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078c9e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f323 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735927:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06e00/0x8b38d407a078c9fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f323 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.735934:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf356788700) 00010000:00010000:3.0:1785219865.735936:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219865.735938:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06e00, rc 0) 00000100:00100000:3.0:1785219865.736011:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:10232:x1871938444092160:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1073us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219865.736018:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1785219865.745645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219865.745738:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444092416 00000100:00100000:3.0:1785219865.745748:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444092416 00000100:00100000:3.0:1785219865.745807:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1785219865.745818:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:10232:x1871938444092416:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219865.745839:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219865.745860:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f32a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.745936:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.745951:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.745977:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.746045:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.746056:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.746063:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747542:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078ca17 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747560:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078ca17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747569:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078ca17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219865.747580:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1785219865.747796:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747806:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747813:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747819:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219865.747830:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747837:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747849:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf356788700) 00010000:00010000:3.0:1785219865.747852:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219865.747856:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747862:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747875:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747881:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747886:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747892:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219865.747894:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747900:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747907:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf356788900) 00010000:00010000:3.0:1785219865.747910:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219865.747920:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.747925:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca10 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.748729:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f32a expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.748749:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078ca17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f32a expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219865.748757:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:3.0:1785219865.748760:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219865.748762:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07200, rc 0) 00000100:00100000:3.0:1785219865.748898:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:10232:x1871938444092416:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3081us (3260us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1785219865.748907:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:0.0:1785219865.764854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219865.765027:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444092544 00000100:00100000:2.0:1785219865.765037:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444092544 00000100:00100000:2.0:1785219865.765090:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1785219865.765100:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:10232:x1871938444092544:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1785219865.765257:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:10232:x1871938444092544:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219865.765265:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00010000:00010000:1.0:1785219865.965673:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785219866.156127:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1785219866.543033:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465099904:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.543108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219866.543204:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1785219866.543211:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465099520:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.543240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219866.543264:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465100032:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.543288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219866.543326:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465099648:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.543349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219866.543407:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465100160:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.544071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219866.544105:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785219866.544112:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465099776:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.544138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219866.544178:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099904 00000100:00100000:3.0:1785219866.544186:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099904 00000100:00100000:3.0:1785219866.544237:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465100160 00000100:00100000:3.0:1785219866.544241:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465100160 00000100:00100000:3.0:1785219866.544266:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785219866.544274:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465099904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.544338:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465099904:12345-0@lo:400:kworker.0 Request processed in 65us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219866.544344:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785219866.544470:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785219866.544480:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465100160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219866.544525:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465100160:12345-0@lo:400:kworker.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219866.544531:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785219866.544653:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099520 00000100:00100000:3.0:1785219866.544658:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099520 00000100:00100000:3.0:1785219866.544695:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1785219866.544702:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3306:x1871938465099520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.544735:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3306:x1871938465099520:12345-0@lo:400:kworker.0 Request processed in 34us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219866.544741:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1785219866.544769:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465100032 00000100:00100000:3.0:1785219866.544773:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465100032 00000100:00100000:3.0:1785219866.544814:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099648 00000100:00100000:3.0:1785219866.544817:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099648 00000100:00100000:3.0:1785219866.544830:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465099776 00000100:00100000:3.0:1785219866.544832:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465099776 00000100:00100000:3.0:1785219866.544846:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1785219866.544851:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465100032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.544897:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465100032:12345-0@lo:400:kworker.0 Request processed in 45us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219866.544903:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1785219866.544915:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1785219866.544920:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465099648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.544946:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465099648:12345-0@lo:400:kworker.0 Request processed in 26us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219866.544952:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1785219866.544962:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1785219866.544968:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465099776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.545166:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465099776:12345-0@lo:400:kworker.0 Request processed in 197us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219866.545172:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1785219866.545195:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785219866.545200:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785219866.545201:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219866.545238:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465099776:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.545250:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465099648:0@lo:400:kworker.0 00010000:00080000:3.0:1785219866.545263:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf348a3f800 x1871938465100160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785219882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219866.545274:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465100160:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.545487:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465099520:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.545507:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465100032:0@lo:400:kworker.0 00000100:00100000:3.0:1785219866.545531:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465099904:0@lo:400:kworker.0 00000100:00100000:1.0:1785219866.642820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219866.642973:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444092800 00000100:00100000:3.0:1785219866.642992:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444092800 00000100:00100000:3.0:1785219866.643074:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:3.0:1785219866.643086:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444092800:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219866.643162:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2360:x1871938444092800:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 78us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219866.643169:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00080000:1.0:1785219866.643229:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219866.653964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219866.660813:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444092672 00000100:00100000:3.0:1785219866.660830:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444092672 00000100:00100000:3.0:1785219866.661490:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 282 00000100:00100000:3.0:1785219866.661503:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444092672:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219866.661584:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444092672:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 83us (7628us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219866.661592:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 282 00010000:00010000:0.0:1785219866.989631:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219867.058314:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785219867.058349:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465100288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219867.058452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219867.058677:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465100288 00000100:00100000:1.0:1785219867.058696:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465100288 00000100:00100000:1.0:1785219867.058748:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785219867.058758:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465100288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219867.058795:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219867.058844:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465100288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219867.058852:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1785219867.058930:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf38116df80 x1871938465100288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219867.058953:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465100288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219867.496561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.496636:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444092928 00000100:00100000:3.0:1785219867.496646:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444092928 00000100:00100000:3.0:1785219867.496720:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1785219867.496729:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:10275:x1871938444092928:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219867.496751:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219867.496771:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f331 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.496836:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.496863:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.496877:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.496892:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.496898:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.496904:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785219867.497201:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785219867.499218:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499237:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499245:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499252:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219867.499257:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499265:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499283:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9600) 00010000:00010000:3.0:1785219867.499293:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219867.499299:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499307:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499322:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499329:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499336:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499341:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219867.499345:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499351:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499360:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cf356788900) 00010000:00010000:3.0:1785219867.499748:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219867.499753:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499760:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499816:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f331 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499841:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9600) 00010000:00010000:3.0:1785219867.499845:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219867.499850:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f331 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.499861:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06600, rc 0) 00000100:00100000:3.0:1785219867.499970:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:10275:x1871938444092928:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 3241us (3416us total) trans 0 rc 301/301 00000100:00100000:3.0:1785219867.499988:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1785219867.507928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.508181:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444093184 00000100:00100000:3.0:1785219867.508191:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444093184 00000100:00100000:3.0:1785219867.508245:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1785219867.508255:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:10275:x1871938444093184:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1785219867.508304:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219867.508330:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078c9df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f31c expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.508347:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf34a6a9600) 00010000:00010000:3.0:1785219867.508359:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219867.517969:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.518001:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.518013:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.518024:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.518031:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.518036:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219867.527467:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1785219867.527486:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.527507:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.527513:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.527519:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219867.527523:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.527530:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.527548:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219867.527675:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219867.527683:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.527690:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ca3a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219867.527711:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef9c0d15 reply state 00000000ab6dd688 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219867.527720:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785219867.527848:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:10275:x1871938444093184:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 19590us (19922us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1785219867.527861:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00010000:00010000:0.0:1785219867.536160:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.536178:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.536186:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.536193:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219867.536197:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.536219:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.536238:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cf345fcd000) 00010000:00010000:0.0:1785219867.536241:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219867.536245:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.536251:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078ca41 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219867.583336:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.583550:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444093312 00000100:00100000:3.0:1785219867.583561:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444093312 00000100:00100000:3.0:1785219867.583627:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1785219867.583636:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:10283:x1871938444093312:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:3.0:1785219867.583661:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219867.583685:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f338 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.583796:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.583811:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.583822:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219867.583888:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785219867.583893:0:8055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219867.583933:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.583956:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f338 expref: 11 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.583986:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f338 expref: 10 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.583996:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219867.583999:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219867.584002:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06000, rc 0) 00000100:00100000:3.0:1785219867.584057:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:10283:x1871938444093312:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 422us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219867.584065:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1785219867.624488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.625531:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444093440 00000100:00100000:3.0:1785219867.625544:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444093440 00000100:00100000:3.0:1785219867.625624:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1785219867.625634:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:10289:x1871938444093440:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219867.625655:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219867.625676:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f33f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625739:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625754:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625765:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625780:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625787:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625793:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625918:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078ca6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625925:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078ca6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.625931:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078ca6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219867.625987:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1785219867.625991:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219867.626090:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078ca6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626103:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626109:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626115:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626120:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219867.626123:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626130:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626141:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219867.626144:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219867.626149:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626155:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ca5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626167:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626182:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626188:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626193:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219867.626196:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626203:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626210:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cf356788800) 00010000:00010000:3.0:1785219867.626213:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219867.626215:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626221:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078ca64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626250:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ca56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f33f expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626263:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078ca6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f33f expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.626271:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219867.626273:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1785219867.626281:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341477a00, rc 0) 00000100:00100000:3.0:1785219867.626430:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:10289:x1871938444093440:12345-192.168.203.31@tcp:101:bash.0 Request processed in 797us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219867.626438:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1785219867.629740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219867.630088:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444093696 00000100:00100000:0.0:1785219867.630100:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444093696 00000100:00100000:0.0:1785219867.630245:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1785219867.630256:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:10289:x1871938444093696:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1785219867.630279:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219867.630300:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ca72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f346 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.630468:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.630495:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.630506:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.630521:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.630542:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.630549:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785219867.633352:0:8055:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1785219867.633565:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633582:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633593:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633630:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633638:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633645:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633651:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219867.633656:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633663:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633687:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:0.0:1785219867.633690:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219867.633695:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633702:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078ca79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785219867.633714:0:8055:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2f33488 reply state 0000000060422980 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219867.633723:0:8055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785219867.633759:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ca72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 14 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633774:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 13 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219867.633781:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219867.633784:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785219867.633786:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1000, rc 0) 00000100:00100000:0.0:1785219867.633855:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:10289:x1871938444093696:12345-192.168.203.31@tcp:101:bash.0 Request processed in 3600us (4123us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1785219867.633863:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00010000:00010000:3.0:1785219867.638882:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.638900:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.638908:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.638914:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219867.638919:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.638927:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.638943:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf342843e00) 00010000:00010000:3.0:1785219867.638951:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219867.638957:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.638963:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ca80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219867.651087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219867.652947:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444093824 00000100:00100000:1.0:1785219867.652963:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444093824 00000100:00100000:1.0:1785219867.653038:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1785219867.653047:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1871938444093824:12345-192.168.203.31@tcp:8:bash.0 00010000:00080000:1.0:1785219867.653418:0:6588:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:1.0:1785219867.653456:0:6588:0:(genops.c:1406:class_connect()) connect: client 3c48a627-3c4f-49d5-b2ec-dae54c1457bb, cookie 0x8b38d407a078ca95 00002000:00100000:1.0:1785219867.653470:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c48a627-3c4f-49d5-b2ec-dae54c1457bb/ffff9cf381fb3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785219867.653483:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785219867.653756:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785219867.653791:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9cf381fb1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219867.653942:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2358:x1871938444093824:12345-192.168.203.31@tcp:8:bash.0 Request processed in 893us (2863us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219867.653950:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1785219867.661197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.661391:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444093952 00000100:00100000:3.0:1785219867.661413:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444093952 00000100:00100000:3.0:1785219867.661495:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1785219867.661505:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:0:x1871938444093952:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219867.661523:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219867.661550:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f34d expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785219867.661590:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:1.0:1785219867.661705:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785219867.661798:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1785219867.661804:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219867.661813:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.661833:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.661847:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476800, rc 0) 00000100:00100000:3.0:1785219867.661918:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:0:x1871938444093952:12345-192.168.203.31@tcp:101:bash.0 Request processed in 414us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219867.661926:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1785219867.670847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.671239:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444094080 00000100:00100000:3.0:1785219867.671250:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444094080 00000100:00100000:3.0:1785219867.671317:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1785219867.671327:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:10289:x1871938444094080:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219867.671345:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219867.671399:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f354 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.671453:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.671463:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219867.671468:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219867.671474:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.671508:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.671523:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 8 pid: 6586 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219867.671538:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6589:1871938465100416:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219867.673194:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1785219867.683094:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219867.683214:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444094208 00000100:00100000:2.0:1785219867.683229:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444094208 00010000:00010000:2.0:1785219867.683278:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 9 pid: 6586 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219867.683325:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:2.0:1785219867.683334:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2362:x1871938444094208:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219867.683348:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219867.683428:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 9 pid: 6586 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.683443:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 9 pid: 6586 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.683471:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219867.683476:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219867.683484:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.683495:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.683533:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219867.683568:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5780:1871938465100544:192.168.203.31@tcp:105: 00000100:00100000:2.0:1785219867.683650:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf345f54480 going to sleep for 11 seconds 00010000:00010000:3.0:1785219867.684952:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087d85dad/0x8b38d407a078ca9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f34d expref: 9 pid: 6586 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219867.684993:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6589:1871938465100416:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219867.685034:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.685216:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476400, rc 0) 00000100:00100000:3.0:1785219867.685497:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:10289:x1871938444094080:12345-192.168.203.31@tcp:101:bash.0 Request processed in 14169us (14657us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219867.685509:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1785219867.693707:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348064a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5780:1871938465100544:192.168.203.31@tcp:105: 00010000:00010000:2.0:1785219867.693746:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219867.695052:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444094208:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 11703us (11958us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219867.695069:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:0.0:1785219867.698045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.698912:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444094464 00000100:00100000:3.0:1785219867.698925:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444094464 00000100:00100000:3.0:1785219867.699039:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1785219867.699053:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:10289:x1871938444094464:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1785219867.699855:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:10289:x1871938444094464:12345-192.168.203.31@tcp:35:bash.0 Request processed in 792us (1806us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1785219867.699872:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1785219867.821863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219867.822015:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444094720 00000100:00100000:2.0:1785219867.822028:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444094720 00000100:00100000:2.0:1785219867.822113:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1785219867.822125:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:10299:x1871938444094720:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219867.822157:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219867.822189:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078caaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f35b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219867.822534:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1785219867.822755:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078caaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f35b expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.822773:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:2.0:1785219867.822776:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785219867.822782:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078caaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f35b expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219867.822801:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80e00, rc 0) 00000100:00100000:2.0:1785219867.822882:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:10299:x1871938444094720:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 759us (1032us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1785219867.822890:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1785219867.829196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219867.830528:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444094976 00000100:00100000:0.0:1785219867.830548:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444094976 00000100:00100000:0.0:1785219867.830665:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1785219867.830677:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:10299:x1871938444094976:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785219867.831082:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:10299:x1871938444094976:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 406us (1900us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1785219867.831092:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1785219867.926964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219867.927268:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444095104 00000100:00100000:1.0:1785219867.927282:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444095104 00000100:00100000:1.0:1785219867.927500:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1785219867.927513:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:10305:x1871938444095104:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219867.927547:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219867.927577:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f362 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.927900:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cabf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.927922:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.927937:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219867.928496:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1785219867.928503:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219867.928546:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.928592:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f362 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.928617:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cabf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f362 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.928628:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219867.928631:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785219867.928657:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29c00, rc 0) 00000100:00100000:1.0:1785219867.929120:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:10305:x1871938444095104:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1607us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219867.929130:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:2.0:1785219867.933875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.934025:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444095360 00000100:00100000:3.0:1785219867.934039:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444095360 00000100:00100000:3.0:1785219867.934269:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1785219867.934282:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:10305:x1871938444095360:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219867.934465:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219867.934495:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f369 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.934785:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cacd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.934802:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.934816:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219867.934830:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1785219867.935188:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f369 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.935211:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cacd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f369 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.935233:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219867.935236:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219867.935240:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476000, rc 0) 00000100:00100000:3.0:1785219867.935471:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:10305:x1871938444095360:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1191us (1609us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1785219867.935481:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1785219867.938569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219867.938755:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444095488 00000100:00100000:1.0:1785219867.938770:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444095488 00000100:00100000:1.0:1785219867.938860:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785219867.938873:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2359:x1871938444095488:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219867.938895:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219867.938929:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cacd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f369 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.938953:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219867.938960:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219867.939043:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:2359:x1871938444095488:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 173us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219867.939051:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1785219867.939199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.941993:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444095744 00000100:00100000:3.0:1785219867.942013:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444095744 00000100:00100000:3.0:1785219867.942151:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1785219867.942163:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:10305:x1871938444095744:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219867.942197:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219867.942227:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cadb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f370 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.944098:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cae2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.944127:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cae2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.944144:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cae2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219867.944166:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1785219867.944784:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cadb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f370 expref: 21 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.944837:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cae2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f370 expref: 20 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.944848:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219867.944852:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785219867.944856:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07c00, rc 0) 00000100:00100000:3.0:1785219867.944961:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:10305:x1871938444095744:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2798us (5759us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1785219867.944979:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1785219867.953360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219867.953488:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444095872 00000100:00100000:3.0:1785219867.953501:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444095872 00000100:00100000:3.0:1785219867.953585:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:3.0:1785219867.953597:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444095872:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:3.0:1785219867.953669:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.953693:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.953703:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219867.953708:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219867.953714:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.953761:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219867.953795:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 7 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219867.953815:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6586:1871938465100672:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219867.953950:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7240 going to sleep for 11 seconds 00000100:00100000:3.0:1785219867.957958:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6586:1871938465100672:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219867.958205:0:6586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219867.972636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219867.972800:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444096000 00000100:00100000:1.0:1785219867.972810:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444096000 00002000:00100000:1.0:1785219867.972934:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9cf348a3bb80 x1871938444096000/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:483/0 lens 504/0 e 0 to 0 dl 1785219878 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219867.972946:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf348a3bb80 with x1871938444096000 ext(0->12) 00010000:00010000:1.0:1785219867.972957:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 8 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219867.972985:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 8 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785219867.973015:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf348a3bb80 00000100:00100000:1.0:1785219867.973086:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1785219867.973096:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444096000:12345-192.168.203.31@tcp:4:lfs.0 00010000:00010000:3.0:1785219868.012723:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785219868.061090:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000100:00100000:3.0:1785219868.068543:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444096000:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 95432us (95900us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1785219868.068573:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:3.0:1785219868.068593:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9cf348a3bb80 x1871938444096000/t4294967299(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:483/0 lens 504/448 e 0 to 0 dl 1785219878 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785219868.068606:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf348a3bb80 with x1871938444096000 ext(0->12) 00010000:00010000:3.0:1785219868.068620:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.068657:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785219868.068668:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf348a3bb80 00000100:00100000:2.0:1785219868.072312:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219868.072486:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444096128 00000100:00100000:0.0:1785219868.072501:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444096128 00010000:00010000:0.0:1785219868.072558:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219868.072623:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:0.0:1785219868.072635:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444096128:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219868.072655:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1785219868.072682:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1785219868.072685:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1785219867 00002000:00010000:0.0:1785219868.072688:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1785219867 00002000:00010000:0.0:1785219868.072691:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1785219867 00010000:00010000:0.0:1785219868.072699:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.072715:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.072775:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcbf7726/0x8b38d407a078caa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f354 expref: 9 pid: 6589 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.072802:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785219868.072807:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785219868.072814:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.072826:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.072868:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219868.072951:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444096128:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 317us (664us total) trans 0 rc 0/0 00010000:00010000:3.0:1785219868.072957:0:6586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219868.072961:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00010000:00010000:3.0:1785219868.072984:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.073017:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.073028:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.073036:0:6586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.073045:0:6586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219868.073050:0:6586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.073074:0:6586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.073088:0:6586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.073097:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078caf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219868.073192:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444095872:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 119595us (119844us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219868.073202:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1785219868.083829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.083958:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444096384 00000100:00100000:1.0:1785219868.083983:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444096384 00000100:00100000:0.0:1785219868.084157:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1785219868.084174:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:10305:x1871938444096384:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:0.0:1785219868.084268:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cae2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f370 expref: 20 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219868.084783:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1785219868.084849:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1785219868.085745:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1785219868.085827:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.085849:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 24 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.085859:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.085909:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 24 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.085931:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 24 pid: 8055 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219868.085950:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1871938465100800:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219868.086104:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705840 going to sleep for 11 seconds 00000100:00100000:1.0:1785219868.094892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219868.095032:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444096512 00000100:00100000:3.0:1785219868.095046:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444096512 00010000:00010000:3.0:1785219868.095116:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 25 pid: 8055 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219868.095603:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1785219868.095619:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:2362:x1871938444096512:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219868.096350:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1785219868.096388:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1871938465100800:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219868.096398:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 25 pid: 8055 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.096420:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 25 pid: 8055 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.096435:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.096452:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ca87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f346 expref: 25 pid: 8055 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.096473:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219868.096480:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.096491:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.096522:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.096554:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219868.096677:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.096686:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785219868.096867:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000100:00100000:3.0:1785219868.096997:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:2362:x1871938444096512:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 1251us (1991us total) trans 0 rc 0/0 00000001:00080000:2.0:1785219868.097788:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1785219868.097985:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465100928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785219868.098066:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219868.099575:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf345f54cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219868.100281:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465100928 00000100:00100000:0.0:1785219868.100397:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465100928 00000100:00100000:0.0:1785219868.100498:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219868.100510:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1871938465100928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785219868.100730:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1871938465100928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 221us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219868.100754:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219868.100822:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465100928:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1785219868.102191:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1785219868.106065:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1785219868.106207:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465101056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785219868.107913:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219868.108005:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350f71840 going to sleep for 11 seconds 00000100:00100000:3.0:1785219868.108019:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1785219868.108780:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465101056 00000100:00100000:1.0:1785219868.108793:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465101056 00000100:00100000:1.0:1785219868.108865:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219868.108877:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1871938465101056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785219868.109257:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1871938465101056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 382us (1355us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1785219868.109561:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785219868.109825:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465101056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1785219868.109934:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1785219868.110014:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.110027:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.110035:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.110042:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219868.110047:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.110066:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.110094:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219868.110098:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1785219868.110104:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.110131:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078caf7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785219868.110807:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1785219868.112358:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1785219868.114318:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360966952262ns, next at 361966940074ns, rc = 0 00000001:00080000:1.0:1785219868.114343:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1785219868.114470:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219868.114476:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785219868.114490:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cae2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f370 expref: 28 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219868.114929:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:10305:x1871938444096384:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 30756us (31113us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1785219868.114941:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000020:00080000:1.0:1785219868.114949:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1785219868.124952:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219868.125073:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444096640 00000100:00100000:2.0:1785219868.125095:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444096640 00000100:00100000:2.0:1785219868.125216:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1785219868.125229:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:10305:x1871938444096640:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219868.125296:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219868.125327:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cafe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f377 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.125437:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cafe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f377 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.125455:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cafe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f377 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.125478:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:2.0:1785219868.125482:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785219868.125486:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81800, rc 0) 00000100:00100000:2.0:1785219868.125556:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:10305:x1871938444096640:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 329us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219868.125564:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1785219868.138741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.141765:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444096896 00000100:00100000:1.0:1785219868.141792:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444096896 00000100:00100000:1.0:1785219868.141896:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1785219868.141909:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:10305:x1871938444096896:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219868.142904:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:10305:x1871938444096896:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 990us (5601us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1785219868.142942:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1785219868.276047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.276717:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444097152 00000100:00100000:1.0:1785219868.276731:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444097152 00000100:00100000:1.0:1785219868.276913:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:1.0:1785219868.276926:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:10315:x1871938444097152:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219868.276960:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219868.276997:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f37e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219868.277171:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1785219868.277337:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f37e expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.277356:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:1.0:1785219868.277359:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219868.277409:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f37e expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.277425:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29e00, rc 0) 00000100:00100000:1.0:1785219868.277511:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:10315:x1871938444097152:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 588us (1480us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1785219868.277519:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1785219868.282560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219868.282713:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444097280 00000100:00100000:3.0:1785219868.282727:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444097280 00000100:00100000:3.0:1785219868.282808:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:3.0:1785219868.283131:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:10315:x1871938444097280:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1785219868.283240:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.283264:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.283281:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.283300:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.283308:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.283315:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.284714:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.284758:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.284771:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219868.284977:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.284995:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285004:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285013:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285021:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219868.285026:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285036:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285445:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219868.285451:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219868.285459:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285467:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cb13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285755:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285762:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285769:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285775:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219868.285777:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285783:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285795:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf356788800) 00010000:00010000:3.0:1785219868.285798:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219868.285801:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.285807:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cb1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.286301:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.286312:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.286318:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.286334:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219868.286337:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.286342:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.286353:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219868.286356:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219868.286360:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.286451:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219868.287008:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:10315:x1871938444097280:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 3875us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219868.287022:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1785219868.294688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.294920:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444097536 00000100:00100000:1.0:1785219868.294934:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444097536 00000100:00100000:1.0:1785219868.295071:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1785219868.295083:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:10315:x1871938444097536:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219868.295793:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:10315:x1871938444097536:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 708us (1308us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1785219868.295803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1785219868.343807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219868.344007:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444097792 00000100:00100000:3.0:1785219868.344017:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444097792 00000100:00100000:3.0:1785219868.344185:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1785219868.344196:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:10318:x1871938444097792:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219868.344221:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219868.344243:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cb28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f385 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344333:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344411:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344423:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344441:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344449:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344455:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344597:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344607:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344614:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219868.344624:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1785219868.344722:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344731:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344737:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344749:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219868.344754:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344762:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344777:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219868.344780:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219868.344785:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344791:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476000/0x8b38d407a078cb2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344806:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344813:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344819:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344823:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219868.344827:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344832:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344853:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf356788800) 00010000:00010000:3.0:1785219868.344855:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219868.344859:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344865:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cb36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344908:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cb28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 34 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344923:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 33 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.344930:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219868.344933:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219868.344936:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07c00, rc 0) 00000100:00100000:3.0:1785219868.345028:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:10318:x1871938444097792:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 833us (1229us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1785219868.345036:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1785219868.349221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.349453:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444097920 00000100:00100000:1.0:1785219868.349463:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444097920 00000100:00100000:1.0:1785219868.349518:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1785219868.349528:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:10318:x1871938444097920:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1785219868.349601:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349618:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349629:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349656:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349663:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349669:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349675:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219868.349679:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349686:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349710:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219868.349713:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219868.349718:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.349724:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219868.349797:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:10318:x1871938444097920:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 270us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219868.349804:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1785219868.354659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.354737:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444098176 00000100:00100000:1.0:1785219868.354747:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444098176 00000100:00100000:1.0:1785219868.354802:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1785219868.354812:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:10318:x1871938444098176:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219868.355184:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:10318:x1871938444098176:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 372us (532us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1785219868.355193:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1785219868.622263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.622460:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444098432 00000100:00100000:1.0:1785219868.622575:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444098432 00000100:00100000:1.0:1785219868.622827:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1785219868.622840:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:10349:x1871938444098432:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1785219868.622875:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219868.622903:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f38c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.623118:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cb59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.623156:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.623171:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219868.623188:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1785219868.623397:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f38c expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.623420:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cb59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f38c expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.623430:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219868.623433:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219868.623437:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29800, rc 0) 00000100:00100000:1.0:1785219868.623755:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:10349:x1871938444098432:12345-192.168.203.31@tcp:101:cat.0 Request processed in 916us (1504us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1785219868.623765:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:0.0:1785219868.630724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219868.630844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.631638:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444098816 00000100:00100000:1.0:1785219868.631653:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444098816 00000100:00100000:1.0:1785219868.631759:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1785219868.631771:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:2360:x1871938444098816:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219868.631792:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219868.631827:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cb59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f38c expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.631878:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219868.631884:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219868.631962:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:2360:x1871938444098816:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 193us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219868.631979:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1785219868.635436:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444098688 00000100:00100000:2.0:1785219868.635457:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444098688 00000100:00100000:2.0:1785219868.635738:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1785219868.635751:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:10349:x1871938444098688:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:2.0:1785219868.636285:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:10349:x1871938444098688:12345-192.168.203.31@tcp:35:cat.0 Request processed in 534us (5572us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1785219868.636388:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1785219868.735134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.735276:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444099072 00000100:00100000:1.0:1785219868.735286:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444099072 00000100:00100000:1.0:1785219868.735354:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1785219868.735389:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:10355:x1871938444099072:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1785219868.735413:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219868.735416:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785219868.735442:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cabf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f362 expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.735460:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219868.735464:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219868.735477:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cb67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f393 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.735569:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.735583:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 36 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.735591:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.735635:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 36 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.735648:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 36 pid: 8055 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219868.735661:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465101184:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219868.735744:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705840 going to sleep for 11 seconds 00000100:00100000:3.0:1785219868.738722:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.738825:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465101184:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219868.738850:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219868.738914:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444099200 00000100:00100000:0.0:1785219868.738921:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444099200 00010000:00010000:0.0:1785219868.738954:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 37 pid: 8055 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219868.739000:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1785219868.739009:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:2361:x1871938444099200:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219868.739024:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219868.739031:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 37 pid: 8055 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.739043:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 37 pid: 8055 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.739080:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cb3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f385 expref: 37 pid: 8055 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.739115:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:0.0:1785219868.739120:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.739129:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.739137:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.739194:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219868.739247:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:2361:x1871938444099200:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 238us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219868.739254:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00010000:00010000:1.0:1785219868.743205:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.743222:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219868.743246:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1785219868.743590:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cb67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.743613:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.743622:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219868.743625:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219868.743641:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29e00, rc 0) 00000100:00100000:1.0:1785219868.743747:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:10355:x1871938444099072:12345-192.168.203.31@tcp:101:dd.0 Request processed in 8384us (8621us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1785219868.743756:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:3.0:1785219868.746769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219868.746839:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444099456 00000100:00100000:0.0:1785219868.746849:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444099456 00000100:00100000:0.0:1785219868.746903:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1785219868.746910:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:10355:x1871938444099456:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:0.0:1785219868.747502:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.747521:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219868.747532:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785219868.747583:0:8055:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1785219868.747612:0:8055:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3c7e72f reply state 00000000ccd5e8a3 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219868.747634:0:8055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785219868.747733:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:10355:x1871938444099456:12345-192.168.203.31@tcp:36:dd.0 Request processed in 821us (971us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1785219868.747740:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000020:00080000:0.0:1785219868.747746:0:8055:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785219868.749929:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.749945:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.749953:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.749982:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219868.749987:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.749996:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.750013:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219868.750016:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219868.750020:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219868.750026:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078cb7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219868.966182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219868.966826:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444099584 00000100:00100000:2.0:1785219868.966838:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444099584 00000100:00100000:2.0:1785219868.966904:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:2.0:1785219868.966914:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:10369:x1871938444099584:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:2.0:1785219868.966942:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219868.966973:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cb83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f39a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967078:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967092:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967103:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967118:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967126:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967132:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967234:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967245:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967272:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967319:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.967333:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 39 pid: 5795 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219868.967346:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465101312:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219868.967495:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf36450f300 going to sleep for 11 seconds 00000100:00100000:0.0:1785219868.973197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.973839:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444099840 00000100:00100000:1.0:1785219868.973848:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444099840 00000100:00100000:1.0:1785219868.973922:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1785219868.973932:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+40:5574:x1871938444099840:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785219868.974295:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:5574:x1871938444099840:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 364us (1106us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1785219868.974303:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1785219868.974573:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465101312:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219868.974601:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219868.982471:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219868.982623:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444099968 00000100:00100000:1.0:1785219868.982633:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444099968 00010000:00010000:1.0:1785219868.982675:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 41 pid: 5795 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219868.982715:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:1.0:1785219868.982724:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:2361:x1871938444099968:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219868.982737:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219868.982744:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 41 pid: 5795 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.982757:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 41 pid: 5795 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.982779:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f393 expref: 41 pid: 5795 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.982813:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219868.982819:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.982828:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.982834:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219868.982870:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219868.982962:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+40:2361:x1871938444099968:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 238us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219868.982986:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00010000:00010000:2.0:1785219868.984161:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984174:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219868.984223:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785219868.984227:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219868.984269:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984284:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984309:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984316:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984323:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984329:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219868.984333:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984340:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984354:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:2.0:1785219868.984356:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219868.984361:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984394:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cb8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984408:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984414:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984419:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984431:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219868.984434:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984440:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984448:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf345fcda00) 00010000:00010000:2.0:1785219868.984450:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219868.984453:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984459:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cb91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984500:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cb83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f39a expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984518:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f39a expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219868.984525:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:2.0:1785219868.984527:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219868.984529:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:2.0:1785219868.984576:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:10369:x1871938444099584:12345-192.168.203.31@tcp:101:stat.0 Request processed in 17664us (18403us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219868.984584:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:1.0:1785219869.035639:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219869.070061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.070214:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444100224 00000100:00100000:1.0:1785219869.070225:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444100224 00000100:00100000:1.0:1785219869.070307:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1785219869.070318:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:10375:x1871938444100224:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:1.0:1785219869.070400:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219869.070428:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cb98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f39a expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.070448:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219869.070453:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219869.070660:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.070691:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.070701:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219869.070757:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1785219869.070785:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024882999 reply state 00000000884b0063 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219869.070795:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785219869.070912:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:10375:x1871938444100224:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 596us (859us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1785219869.070920:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000020:00080000:1.0:1785219869.070925:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1785219869.071118:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785219869.075055:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.075073:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.075080:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.075086:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219869.075091:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.075099:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.075133:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219869.075136:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219869.075141:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.075148:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cb9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219869.099740:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785219869.099764:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465101440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219869.099830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219869.099895:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465101440 00000100:00100000:1.0:1785219869.099901:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465101440 00000100:00100000:1.0:1785219869.099954:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785219869.099973:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465101440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219869.100010:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219869.100054:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465101440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219869.100061:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1785219869.100085:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219869.100115:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465101440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219869.214744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.215010:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444100352 00000100:00100000:1.0:1785219869.215023:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444100352 00000100:00100000:1.0:1785219869.215162:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:1.0:1785219869.215175:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+40:10389:x1871938444100352:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:1.0:1785219869.215211:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219869.215242:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3a1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215345:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215584:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215603:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215621:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215629:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215636:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215757:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215766:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215794:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219869.215841:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1785219869.215846:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219869.215874:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215889:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215899:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215906:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215914:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215922:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219869.215927:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215936:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215951:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219869.215955:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219869.215973:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.215994:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216010:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216017:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216023:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216028:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219869.216032:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216038:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216894:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf34a6a9500) 00010000:00010000:1.0:1785219869.216902:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219869.216909:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216918:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216980:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 42 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.216997:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 41 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.217017:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219869.217019:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219869.217022:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28200, rc 0) 00000100:00100000:1.0:1785219869.217134:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:10389:x1871938444100352:12345-192.168.203.31@tcp:101:stat.0 Request processed in 1961us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219869.217143:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:0.0:1785219869.300420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.300579:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444100608 00000100:00100000:1.0:1785219869.300592:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444100608 00000100:00100000:1.0:1785219869.300669:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1785219869.300681:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:10399:x1871938444100608:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219869.300711:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219869.300742:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cbc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3a8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219869.300904:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1785219869.301097:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cbc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a8 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.301115:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:1.0:1785219869.301119:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219869.301126:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078cbc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a8 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.301144:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29800, rc 0) 00000100:00100000:1.0:1785219869.301228:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+42:10399:x1871938444100608:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 549us (877us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1785219869.301257:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:0.0:1785219869.306734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.306823:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444100864 00000100:00100000:1.0:1785219869.306835:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444100864 00000100:00100000:1.0:1785219869.306910:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1785219869.306921:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+42:10399:x1871938444100864:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219869.307310:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+43:10399:x1871938444100864:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 390us (589us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1785219869.307319:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1785219869.362555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219869.363648:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444101120 00000100:00100000:2.0:1785219869.363666:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444101120 00000100:00100000:2.0:1785219869.363756:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:2.0:1785219869.363769:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+43:10405:x1871938444101120:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1785219869.363810:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219869.363841:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cbd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3af expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.363983:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.364000:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 44 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.364009:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.364052:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 44 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.364068:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 44 pid: 5795 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219869.364086:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465101568:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219869.364220:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a7f6900 going to sleep for 11 seconds 00000100:00100000:3.0:1785219869.367959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219869.368203:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444101248 00000100:00100000:0.0:1785219869.368216:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444101248 00010000:00010000:0.0:1785219869.368273:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 45 pid: 5795 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219869.368332:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1785219869.368344:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+45:2361:x1871938444101248:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219869.368483:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219869.368494:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 45 pid: 5795 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.368511:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 45 pid: 5795 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.368540:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:0.0:1785219869.368564:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.368577:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.368585:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.368611:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219869.368797:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cbbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3a1 expref: 45 pid: 5795 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219869.368819:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465101568:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219869.368858:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.368868:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.368874:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219869.368899:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1785219869.369120:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cbd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.369142:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.369153:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:2.0:1785219869.369156:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785219869.369159:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81400, rc 0) 00000100:00100000:0.0:1785219869.369265:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+45:2361:x1871938444101248:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 922us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219869.369275:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1785219869.369562:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+44:10405:x1871938444101120:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5796us (7022us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1785219869.369571:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:0.0:1785219869.377488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.377924:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444101504 00000100:00100000:1.0:1785219869.377937:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444101504 00000100:00100000:1.0:1785219869.378916:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1785219869.378932:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+44:10405:x1871938444101504:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1785219869.379536:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.379559:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.379573:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219869.379635:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1785219869.379658:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8231ece reply state 00000000ce8030b7 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219869.379668:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785219869.379901:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:10405:x1871938444101504:12345-192.168.203.31@tcp:36:bash.0 Request processed in 970us (2487us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1785219869.379922:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000020:00080000:1.0:1785219869.379929:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785219869.383190:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.383211:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.383220:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.383226:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219869.383232:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.383241:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.383262:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219869.383265:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219869.383269:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.383360:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cbe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219869.398437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.398596:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444101632 00000100:00100000:1.0:1785219869.398609:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444101632 00000100:00100000:1.0:1785219869.398690:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1785219869.398703:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+46:10405:x1871938444101632:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219869.399249:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219869.399283:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3b6 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.399459:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.399487:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.399666:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.399716:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.399734:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 47 pid: 5794 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219869.399751:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465101696:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219869.399989:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf244af5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219869.407458:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219869.407626:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465101696:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219869.407668:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219869.407795:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444101760 00000100:00100000:0.0:1785219869.407805:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444101760 00010000:00010000:0.0:1785219869.407853:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 48 pid: 5794 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219869.407903:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:0.0:1785219869.407913:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+48:2361:x1871938444101760:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219869.407933:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219869.407942:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 48 pid: 5794 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.407971:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 48 pid: 5794 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.408024:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cbd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3af expref: 48 pid: 5794 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.408042:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:0.0:1785219869.408048:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.408060:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.408069:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219869.408099:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219869.408164:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:2361:x1871938444101760:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 252us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219869.408173:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00010000:00010000:2.0:1785219869.408402:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.408422:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219869.408478:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785219869.408484:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219869.408507:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.408542:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cbec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3b6 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.408559:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3b6 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.408568:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:2.0:1785219869.408570:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219869.408573:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29200, rc 0) 00000100:00100000:2.0:1785219869.408613:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+46:10405:x1871938444101632:12345-192.168.203.31@tcp:101:bash.0 Request processed in 9913us (10191us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219869.408621:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1785219869.415830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219869.415919:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444102016 00000100:00100000:2.0:1785219869.415934:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444102016 00000100:00100000:2.0:1785219869.416020:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1785219869.416033:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+46:10405:x1871938444102016:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1785219869.416889:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:10405:x1871938444102016:12345-192.168.203.31@tcp:35:bash.0 Request processed in 851us (1065us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1785219869.416902:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1785219869.493442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219869.494031:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444102272 00000100:00100000:3.0:1785219869.494046:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444102272 00000100:00100000:3.0:1785219869.494184:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:3.0:1785219869.495609:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:10415:x1871938444102272:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219869.495655:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219869.495690:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cbfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3bd expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219869.495865:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1785219869.496043:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cbfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3bd expref: 49 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.496061:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219869.496065:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785219869.496071:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cbfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3bd expref: 49 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.496090:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06600, rc 0) 00000100:00100000:3.0:1785219869.496599:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+48:10415:x1871938444102272:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2403us (3169us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1785219869.496609:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1785219869.504843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219869.505317:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444102400 00000100:00100000:3.0:1785219869.505331:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444102400 00000100:00100000:3.0:1785219869.505773:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:3.0:1785219869.505819:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+48:10415:x1871938444102400:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1785219869.505940:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.505970:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.505985:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506005:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506013:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506020:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506151:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506434:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506446:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219869.506512:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506527:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506542:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506549:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506556:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219869.506562:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506570:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506584:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219869.506587:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219869.506592:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506598:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506614:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506620:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506626:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506630:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219869.506639:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506646:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506654:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf356788800) 00010000:00010000:3.0:1785219869.506657:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219869.506660:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506667:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506685:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506692:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506699:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506704:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219869.506707:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506714:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506721:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219869.506724:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219869.506732:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.506739:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219869.506849:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+48:10415:x1871938444102400:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1034us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219869.506859:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1785219869.514984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219869.515161:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444102656 00000100:00100000:3.0:1785219869.515175:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444102656 00000100:00100000:3.0:1785219869.515251:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1785219869.515262:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+48:10415:x1871938444102656:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785219869.517977:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+49:10415:x1871938444102656:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 2691us (2989us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1785219869.517993:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1785219869.586434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.586607:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444102912 00000100:00100000:1.0:1785219869.586629:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444102912 00000100:00100000:1.0:1785219869.586711:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:1.0:1785219869.586724:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+49:10418:x1871938444102912:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219869.586759:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219869.586788:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cc1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3c4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.586889:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.586909:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.586924:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.586941:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.586949:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.586956:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587150:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078cc32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587161:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078cc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587191:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078cc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219869.587204:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1785219869.587728:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587740:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587748:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587755:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219869.587760:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587768:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587783:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219869.587786:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219869.587792:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587799:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078cc24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587813:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587819:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587836:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587842:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219869.587845:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587852:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587859:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf34a6a9500) 00010000:00010000:1.0:1785219869.587861:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219869.587864:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587870:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cc2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587932:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cc1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3c4 expref: 52 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587948:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078cc32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3c4 expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.587956:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219869.587971:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219869.587974:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28600, rc 0) 00000100:00100000:1.0:1785219869.588280:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:10418:x1871938444102912:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1556us (1857us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1785219869.588420:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1785219869.597042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219869.597149:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444103040 00000100:00100000:3.0:1785219869.597163:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444103040 00000100:00100000:3.0:1785219869.597261:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1785219869.597274:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:2361:x1871938444103040:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219869.597297:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219869.597333:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078cc32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3c4 expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.597356:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219869.597402:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219869.597483:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:2361:x1871938444103040:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 210us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219869.597493:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1785219869.598659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219869.599712:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444103168 00000100:00100000:2.0:1785219869.599724:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444103168 00000100:00100000:2.0:1785219869.599800:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1785219869.599810:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:10418:x1871938444103168:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1785219869.599900:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.599935:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.599948:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.599994:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.600003:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.600011:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.600018:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219869.600024:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.600296:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.600311:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:2.0:1785219869.601045:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785219869.601078:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.601098:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219869.601342:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:10418:x1871938444103168:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 1527us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219869.601355:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:0.0:1785219869.624419:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219869.624904:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444103424 00000100:00100000:2.0:1785219869.624981:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444103424 00000100:00100000:2.0:1785219869.625110:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1785219869.625123:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:10418:x1871938444103424:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1785219869.625505:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:10418:x1871938444103424:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 383us (1099us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1785219869.625513:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1785219869.813729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219869.815799:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444103680 00000100:00100000:3.0:1785219869.815877:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444103680 00000100:00100000:3.0:1785219869.816241:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:3.0:1785219869.816255:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:10436:x1871938444103680:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1785219869.816300:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219869.816339:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3cb expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.816511:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.816530:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.816555:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219869.816571:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785219869.816744:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3cb expref: 54 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.816768:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3cb expref: 53 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.816779:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:3.0:1785219869.816783:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1785219869.816787:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07400, rc 0) 00000100:00100000:3.0:1785219869.817173:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10436:x1871938444103680:12345-192.168.203.31@tcp:101:cat.0 Request processed in 919us (3457us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1785219869.817183:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1785219869.867064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219869.867189:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444103808 00000100:00100000:3.0:1785219869.867233:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444103808 00000100:00100000:3.0:1785219869.867333:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1785219869.867345:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10437:x1871938444103808:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219869.867425:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219869.867456:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.867545:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.867562:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.867576:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219869.867659:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1785219869.867663:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219869.867687:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.867717:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cc5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d2 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.867738:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d2 expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219869.867748:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219869.867751:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219869.867755:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06600, rc 0) 00000100:00100000:3.0:1785219869.867842:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10437:x1871938444103808:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 499us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219869.867850:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:0.0:1785219869.876771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219869.876880:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444104192 00000100:00100000:2.0:1785219869.876895:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444104192 00000100:00100000:2.0:1785219869.876981:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1785219869.876997:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10437:x1871938444104192:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1785219869.877896:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10437:x1871938444104192:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 900us (1136us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1785219869.877909:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1785219869.881789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.883048:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444104320 00000100:00100000:1.0:1785219869.883067:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444104320 00000100:00100000:1.0:1785219869.883177:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1785219869.883190:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10437:x1871938444104320:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:1.0:1785219869.883220:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1785219869.883256:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cbf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3b6 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.883283:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cc4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3cb expref: 54 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.883298:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cafe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f377 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.883309:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:1.0:1785219869.883323:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219869.883461:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:10437:x1871938444104320:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 272us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219869.883470:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1785219869.888180:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219869.888547:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444104448 00000100:00100000:1.0:1785219869.888560:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444104448 00000100:00100000:1.0:1785219869.888646:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1785219869.888657:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:10437:x1871938444104448:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:1.0:1785219869.888810:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.888854:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219869.888870:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785219869.890638:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219869.892861:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1785219869.892991:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1785219869.893562:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:10437:x1871938444104448:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 4897us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219869.893577:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:0.0:1785219869.930775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219869.933040:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444104576 00000100:00100000:2.0:1785219869.933062:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444104576 00000100:00100000:2.0:1785219869.933188:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:2.0:1785219869.933211:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:10439:x1871938444104576:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219869.933262:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219869.933295:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3d9 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934576:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934605:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934620:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934642:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934651:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934658:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934805:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934816:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934823:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219869.934872:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785219869.934892:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219869.934921:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934936:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934946:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934954:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934970:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934978:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219869.934984:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.934992:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935007:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:2.0:1785219869.935010:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219869.935016:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935022:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935039:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935056:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935061:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935066:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219869.935069:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935076:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935084:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf345fcda00) 00010000:00010000:2.0:1785219869.935087:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219869.935090:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935096:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935157:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cc71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935176:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219869.935185:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf34a6a9500) 00010000:00010000:2.0:1785219869.935188:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785219869.935208:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81400, rc 0) 00000100:00100000:2.0:1785219869.936067:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10439:x1871938444104576:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2858us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219869.936079:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00010000:00010000:0.0:1785219870.060079:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785219870.254603:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219870.254611:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219870.254660:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1785219870.254666:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785219870.254777:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465101824:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785219870.256384:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351d71780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219870.261613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.261885:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444104704 00000100:00100000:3.0:1785219870.261895:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444104704 00000100:00100000:3.0:1785219870.261972:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:3.0:1785219870.261982:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444104704:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1785219870.262062:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444104704:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 81us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.262069:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1785219870.263470:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465101824:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785219870.269148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.269248:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444104832 00000100:00100000:3.0:1785219870.269258:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444104832 00000100:00100000:3.0:1785219870.269320:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1785219870.269330:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10450:x1871938444104832:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785219870.269382:0:8055:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785219870.269510:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10450:x1871938444104832:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.269517:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:0.0:1785219870.274039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219870.275157:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444104960 00000100:00100000:2.0:1785219870.275170:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444104960 00000100:00100000:2.0:1785219870.275240:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1785219870.275251:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10450:x1871938444104960:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785219870.275327:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275343:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275357:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275529:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275538:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275563:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275591:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275599:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275606:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219870.275644:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785219870.275648:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219870.275664:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275676:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275682:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275687:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275693:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219870.275697:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275704:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275723:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:2.0:1785219870.275726:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219870.275732:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275738:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cc8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275752:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275759:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275764:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275770:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219870.275772:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275779:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275786:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219870.275788:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219870.275791:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275796:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cc94 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275820:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275826:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275832:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275837:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219870.275840:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275845:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275853:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf34a6a9500) 00010000:00010000:2.0:1785219870.275855:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219870.275859:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.275865:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cc9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.275967:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10450:x1871938444104960:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 718us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219870.275975:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1785219870.281247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.282322:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444105216 00000100:00100000:3.0:1785219870.282333:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444105216 00000100:00100000:3.0:1785219870.282516:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:3.0:1785219870.282529:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10450:x1871938444105216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219870.282549:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219870.282570:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cca2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3e0 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.282767:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.282783:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.282795:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219870.282807:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785219870.282900:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.282908:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.282989:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.282996:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219870.283001:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.283008:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.283021:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf34a6a9500) 00010000:00010000:3.0:1785219870.283024:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219870.283028:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.283046:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.283088:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cca2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3e0 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.283167:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:3.0:1785219870.283170:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785219870.283174:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cca2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3e0 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.283183:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07c00, rc 0) 00000100:00100000:3.0:1785219870.283288:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444105216:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 712us (1999us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1785219870.283298:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:1.0:1785219870.289785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.289871:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444105344 00000100:00100000:3.0:1785219870.289883:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444105344 00000100:00100000:3.0:1785219870.289952:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1785219870.289972:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444105344:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785219870.290008:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785219870.290242:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444105344:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 271us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.290251:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:0.0:1785219870.294724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219870.295025:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444105600 00000100:00100000:1.0:1785219870.295036:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444105600 00000100:00100000:1.0:1785219870.295106:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:1.0:1785219870.295116:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444105600:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785219870.295138:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219870.295141:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785219870.295169:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cc63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d2 expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.295188:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219870.295193:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219870.295206:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccb7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3e7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785219870.296974:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1785219870.297188:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078ccbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.297202:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078ccbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.297212:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078ccbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.297273:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccb7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3e7 expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.297291:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078ccbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3e7 expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.297300:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf34a6a9100) 00010000:00010000:1.0:1785219870.297303:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219870.297306:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29400, rc 0) 00000100:00100000:1.0:1785219870.297416:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10450:x1871938444105600:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2300us (2699us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1785219870.297424:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1785219870.313141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.313268:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444105856 00000100:00100000:3.0:1785219870.313277:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444105856 00000100:00100000:3.0:1785219870.313348:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1785219870.313391:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10450:x1871938444105856:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785219870.313447:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219870.313474:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078ccbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3e7 expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313493:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf34a6a9100) 00010000:00010000:3.0:1785219870.313503:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219870.313524:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313740:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313751:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313787:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313795:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313803:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313880:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313888:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313906:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313913:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219870.313918:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313927:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313937:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219870.313940:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219870.313945:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313951:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cccc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313975:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313982:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313988:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.313995:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219870.313998:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.314014:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.314022:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x984a8a95 (ffff9cf356788800) 00010000:00010000:3.0:1785219870.314025:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219870.314028:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.314034:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078ccd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x984a8a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.314119:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444105856:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 755us (986us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785219870.314126:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:0.0:1785219870.316871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.316937:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444105984 00000100:00100000:3.0:1785219870.316946:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444105984 00000100:00100000:3.0:1785219870.317005:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1785219870.317015:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10450:x1871938444105984:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219870.317034:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219870.317202:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ccda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3ee expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.317237:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.317250:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.317260:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.317437:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078ccda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 56 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.317452:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.317460:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219870.317463:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785219870.317466:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476400, rc 0) 00000100:00100000:3.0:1785219870.317509:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10450:x1871938444105984:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 496us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.317515:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:0.0:1785219870.321970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.322059:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444106240 00000100:00100000:3.0:1785219870.322068:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444106240 00000100:00100000:3.0:1785219870.322132:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1785219870.322143:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10450:x1871938444106240:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785219870.322231:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.322247:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.322258:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785219870.322968:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1785219870.322979:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363175614502ns, next at 364175612680ns, rc = 0 00000004:00010000:3.0:1785219870.323098:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039b83bc2 reply state 00000000bd4db8f4 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.323109:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785219870.323205:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:10450:x1871938444106240:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1062us (1251us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1785219870.323214:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00010000:00010000:3.0:1785219870.327927:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.327941:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.327949:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.327967:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219870.327972:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.327980:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.327997:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219870.328001:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785219870.328005:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.328012:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476800/0x8b38d407a078cce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.331768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219870.332169:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444106368 00000100:00100000:1.0:1785219870.332178:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444106368 00000100:00100000:1.0:1785219870.332234:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:1.0:1785219870.332244:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:10450:x1871938444106368:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785219870.332268:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219870.332307:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3f5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.332389:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.332404:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.332425:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:1.0:1785219870.332428:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785219870.332432:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28400, rc 0) 00000100:00100000:1.0:1785219870.333455:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:10450:x1871938444106368:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 961us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219870.333467:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:0.0:1785219870.337450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219870.337638:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444106496 00000100:00100000:2.0:1785219870.337648:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444106496 00000100:00100000:2.0:1785219870.337703:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1785219870.337711:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1871938444106496:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1785219870.337892:0:6588:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:2.0:1785219870.337922:0:6588:0:(genops.c:1406:class_connect()) connect: client 3c48a627-3c4f-49d5-b2ec-dae54c1457bb, cookie 0x8b38d407a078ccf6 00002000:00100000:2.0:1785219870.337934:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c48a627-3c4f-49d5-b2ec-dae54c1457bb/ffff9cf381973800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785219870.337966:0:6588:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785219870.338527:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785219870.338559:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9cf381974800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785219870.338635:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2358:x1871938444106496:12345-192.168.203.31@tcp:8:lhsmtool_posix.0 Request processed in 922us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219870.338644:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1785219870.347530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219870.347597:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444106624 00000100:00100000:2.0:1785219870.347607:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444106624 00000100:00100000:2.0:1785219870.347684:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1785219870.347693:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:0:x1871938444106624:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1785219870.347985:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1785219870.401984:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1785219870.401999:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000100:00100000:3.0:1785219870.402189:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:0:x1871938444106624:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 54491us (54663us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1785219870.402205:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1785219870.407921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219870.407975:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444106880 00000100:00100000:1.0:1785219870.407985:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444106880 00000100:00100000:1.0:1785219870.408056:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:1.0:1785219870.408066:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:10450:x1871938444106880:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785219870.408304:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:10450:x1871938444106880:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 238us (391us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1785219870.408313:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1785219870.410816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219870.410881:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444107136 00000100:00100000:0.0:1785219870.410890:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444107136 00000100:00100000:0.0:1785219870.410939:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:0.0:1785219870.410948:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:10450:x1871938444107136:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785219870.414312:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:10450:x1871938444107136:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 3358us (3498us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219870.414322:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1785219870.433062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219870.433144:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444107264 00000100:00100000:0.0:1785219870.433157:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444107264 00000100:00100000:0.0:1785219870.433234:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1785219870.433244:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:10450:x1871938444107264:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785219870.433262:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219870.433281:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078ccfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f3fc expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.433355:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078cd04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.433388:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078cd04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.433400:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078cd04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219870.433435:0:8055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219870.433456:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078cd04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.433481:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078ccfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3fc expref: 60 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.433497:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078cd04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3fc expref: 59 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.433506:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:0.0:1785219870.433509:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785219870.433512:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1800, rc 0) 00000100:00100000:0.0:1785219870.433579:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:10450:x1871938444107264:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 337us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219870.433587:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:1.0:1785219870.438229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.438339:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444107392 00000100:00100000:3.0:1785219870.438352:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444107392 00000100:00100000:3.0:1785219870.438466:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1785219870.438478:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444107392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219870.438503:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219870.438545:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f403 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785219870.438581:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a684b1d, blocks: 0x1 00010000:00010000:3.0:1785219870.438606:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1785219870.438612:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219870.438626:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.438656:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.438674:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf341476800, rc 0) 00000100:00100000:3.0:1785219870.438754:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2359:x1871938444107392:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 277us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.438763:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1785219870.445978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219870.446249:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444107648 00000100:00100000:0.0:1785219870.446264:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444107648 00000100:00100000:0.0:1785219870.446330:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:0.0:1785219870.446350:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:10450:x1871938444107648:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785219870.451209:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:10450:x1871938444107648:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 4850us (5243us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219870.451225:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1785219870.461281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.461545:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444107776 00000100:00100000:3.0:1785219870.461555:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444107776 00000100:00100000:3.0:1785219870.461614:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:3.0:1785219870.461624:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:10450:x1871938444107776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219870.461642:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219870.461669:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f40a expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.461703:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.461714:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219870.461718:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219870.461724:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.461756:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.461770:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 7 pid: 6589 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.461786:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465101952:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219870.461873:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785219870.468145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.468240:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465101952:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219870.468272:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.468399:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07400, rc 0) 00000100:00100000:3.0:1785219870.468451:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:10450:x1871938444107776:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 6828us (7178us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.468459:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1785219870.468667:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444107904 00000100:00100000:0.0:1785219870.468674:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444107904 00010000:00010000:0.0:1785219870.468705:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 7 pid: 6589 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219870.468730:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1785219870.468738:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444107904:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219870.468751:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219870.468775:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 7 pid: 6589 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.468787:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 7 pid: 6589 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.468810:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087d85dad/0x8b38d407a078cd0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f403 expref: 7 pid: 6589 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.468823:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219870.468828:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219870.468836:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.468858:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.468890:0:6603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219870.468904:0:6603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6603:1871938465102080:192.168.203.31@tcp:105: 00000100:00100000:0.0:1785219870.468978:0:6603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a588c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219870.477849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.477992:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444108032 00000100:00100000:3.0:1785219870.478001:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444108032 00002000:00100000:3.0:1785219870.478050:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cf381172680 x1871938444108032/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:486/0 lens 504/0 e 0 to 0 dl 1785219881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785219870.478062:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381172680 with x1871938444108032 ext(0->8) 00002000:00010000:3.0:1785219870.478067:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381172680 00000100:00100000:3.0:1785219870.478103:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1785219870.478112:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2360:x1871938444108032:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1785219870.478786:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2360:x1871938444108032:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 672us (945us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1785219870.478795:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00002000:00100000:3.0:1785219870.478803:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cf381172680 x1871938444108032/t4294967302(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:486/0 lens 504/448 e 0 to 0 dl 1785219881 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785219870.478813:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381172680 with x1871938444108032 ext(0->8) 00002000:00010000:3.0:1785219870.478817:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381172680 00000100:00100000:0.0:1785219870.480545:0:6603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b9a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6603:1871938465102080:192.168.203.31@tcp:105: 00010000:00010000:0.0:1785219870.480570:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219870.485429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219870.485528:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444108160 00000100:00100000:0.0:1785219870.485537:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444108160 00000100:00100000:0.0:1785219870.485594:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:0.0:1785219870.485604:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:10450:x1871938444108160:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1785219870.489147:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2362:x1871938444107904:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 20398us (20999us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219870.489162:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000001:00080000:2.0:1785219870.555496:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000004:00080000:2.0:1785219870.555518:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1785219870.555543:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf3452190c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1785219870.555548:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf3429f2d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf345219e40 00000020:00080000:2.0:1785219870.555552:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf3429f2500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf37edc6c00 00000001:00080000:2.0:1785219870.555583:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1785219870.555651:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1785219870.555699:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1785219870.555826:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1785219870.556051:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465102208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1785219870.556114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219870.556175:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465102208 00000100:00100000:2.0:1785219870.556182:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465102208 00000100:00100000:2.0:1785219870.556237:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785219870.556246:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465102208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1785219870.556420:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1785219870.556424:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785219869 00002000:00010000:2.0:1785219870.556427:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785219870.556430:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1785219869 -> 1785219869 00002000:00010000:2.0:1785219870.556432:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785219870.556471:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465102208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (356us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1785219870.556479:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:2.0:1785219870.556519:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf349c61f80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1785219870.556525:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465102208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1785219870.557001:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465102336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785219870.557033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219870.557109:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465102336 00000100:00100000:3.0:1785219870.557115:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465102336 00000100:00100000:3.0:1785219870.557159:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785219870.557167:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465102336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785219870.557193:0:8158:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1785219870.557220:0:8158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a684b1b, atime: 0x6a684b1b, ctime: 0x6a684b1b, blocks: 0x1 00010000:00010000:3.0:1785219870.557228:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557242:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1785219870.557246:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219870.557253:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557270:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557289:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557299:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557317:0:8158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785219870.557819:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465102336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 652us (785us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1785219870.557827:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1785219870.557852:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219870.557858:0:11513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557879:0:11513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219870.557884:0:11513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557893:0:11513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557910:0:11513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557918:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8984818/0x8b38d407a078cd19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.557936:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219870.557938:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219870.557940:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785219870.558075:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1785219870.558105:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf348a3ce00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1785219870.558112:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465102336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785219870.560548:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:10450:x1871938444108160:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 74937us (75120us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219870.560561:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1785219870.569943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.570031:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444108288 00000100:00100000:3.0:1785219870.570041:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444108288 00000100:00100000:3.0:1785219870.570099:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:3.0:1785219870.570109:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2359:x1871938444108288:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1785219870.631766:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1785219870.631784:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1785219870.631949:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2359:x1871938444108288:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 61836us (62010us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.631969:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000040:00080000:1.0:1785219870.637587:0:11847:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785219870.637596:0:11847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785219870.637635:0:11847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1785219870.637642:0:11847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785219870.640522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.640558:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444108544 00000100:00100000:3.0:1785219870.640573:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444108544 00000100:00100000:3.0:1785219870.640630:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1785219870.640640:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:10450:x1871938444108544:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785219870.640692:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219870.640719:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078cd04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3fc expref: 13 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.640738:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219870.640742:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219870.640771:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.640786:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.640795:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219870.641047:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024e7c573 reply state 00000000ed5c49d5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.641057:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785219870.641142:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:10450:x1871938444108544:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 503us (627us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1785219870.641148:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00010000:00010000:0.0:1785219870.651047:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.651063:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.651071:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.651089:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219870.651094:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.651102:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.651117:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:0.0:1785219870.651120:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219870.651125:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219870.651131:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.656965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219870.657115:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444108672 00000100:00100000:2.0:1785219870.657125:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444108672 00000100:00100000:2.0:1785219870.657196:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1785219870.657206:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444108672:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785219870.657669:0:8158:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1785219870.657673:0:8158:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1785219869 -> 1785219868 00002000:00010000:2.0:1785219870.657676:0:8158:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785219867 00002000:00010000:2.0:1785219870.657679:0:8158:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1785219869 -> 1785219868 00002000:00010000:2.0:1785219870.657681:0:8158:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1785219870.657739:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444108672:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 534us (793us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1785219870.657747:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1785219870.675456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219870.675782:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444108928 00000100:00100000:1.0:1785219870.675792:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444108928 00000100:00100000:1.0:1785219870.675852:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:1.0:1785219870.675862:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:10450:x1871938444108928:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1785219870.675930:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.675947:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 13 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.675968:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.676001:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 13 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.676015:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 13 pid: 8055 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219870.676048:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381170000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465102464:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219870.676136:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37eb146c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219870.685106:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381170000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465102464:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219870.685134:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219870.694280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219870.694358:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444109056 00000100:00100000:2.0:1785219870.694404:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444109056 00010000:00010000:2.0:1785219870.694447:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 14 pid: 8055 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.694487:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1785219870.694496:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:2362:x1871938444109056:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219870.694510:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219870.694517:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 14 pid: 8055 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694531:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 14 pid: 8055 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694565:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341476400/0x8b38d407a078cce1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3ee expref: 14 pid: 8055 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694582:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:2.0:1785219870.694587:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694597:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694605:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694628:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219870.694678:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:2362:x1871938444109056:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219870.694686:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00010000:00010000:2.0:1785219870.694782:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694791:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694818:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694826:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694833:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694846:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219870.694851:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694859:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694869:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:2.0:1785219870.694872:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1785219870.694875:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.694882:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.694924:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:10450:x1871938444108928:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 19064us (19478us total) trans 0 rc -22/-22 00000100:00100000:2.0:1785219870.694932:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1785219870.702302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219870.702392:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444109184 00000100:00100000:2.0:1785219870.702401:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444109184 00000100:00100000:2.0:1785219870.702451:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1785219870.702460:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2359:x1871938444109184:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1785219870.702504:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.702524:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.702543:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219870.702548:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219870.702552:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.702586:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.702600:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 7 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.702615:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1871938465102592:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219870.702690:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6300 going to sleep for 11 seconds 00000100:00100000:3.0:1785219870.707725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.707756:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444109312 00000100:00100000:3.0:1785219870.707772:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444109312 00010000:00010000:3.0:1785219870.707808:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 8 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.707845:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1785219870.707853:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444109312:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219870.707868:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219870.707890:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 8 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.707903:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 8 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.707983:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219870.707988:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219870.707995:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.708006:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.708026:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219870.708073:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444109312:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 220us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.708080:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00010000:00010000:1.0:1785219870.713089:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078cd12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f40a expref: 7 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219870.713112:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1871938465102592:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219870.713136:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713148:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713154:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713187:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713195:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713203:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713226:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219870.713229:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713237:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713257:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.713265:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f977fb2/0x8b38d407a078cd2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219870.713358:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2359:x1871938444109184:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 10897us (11062us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219870.713389:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1785219870.718429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219870.718531:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444109568 00000100:00100000:1.0:1785219870.718540:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444109568 00000100:00100000:1.0:1785219870.718600:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:1.0:1785219870.718609:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:10450:x1871938444109568:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785219870.718687:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.718704:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.718727:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.718937:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.718949:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.718968:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.719002:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219870.719017:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 13 pid: 5793 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219870.719031:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381173b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465102720:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219870.719111:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37eb14f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219870.725452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219870.725622:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381173b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465102720:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219870.725648:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.725671:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444109696 00000100:00100000:2.0:1785219870.725678:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444109696 00010000:00010000:2.0:1785219870.725712:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 14 pid: 5793 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.725753:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1785219870.725763:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:2361:x1871938444109696:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219870.725777:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219870.725783:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 14 pid: 5793 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.725796:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 14 pid: 5793 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.725826:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078ccef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3f5 expref: 14 pid: 5793 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.725841:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:2.0:1785219870.725847:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.725857:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.725864:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.725891:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219870.725923:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.725930:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.725946:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:2361:x1871938444109696:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 185us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219870.725963:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000001:00080000:3.0:1785219870.726119:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1785219870.726272:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1785219870.726323:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1785219870.726447:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381772300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1871938465102848:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785219870.726498:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219870.726530:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf245350d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785219870.726557:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465102848 00000100:00100000:2.0:1785219870.726562:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465102848 00000100:00100000:2.0:1785219870.726605:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785219870.726612:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1871938465102848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785219870.726675:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1871938465102848:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219870.726681:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785219870.726711:0:5794:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1785219870.726716:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf349c61f80, transno 4294967303 00000100:00100000:2.0:1785219870.726735:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381772300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1871938465102848:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1785219870.727269:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1785219870.727333:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1871938465102976:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785219870.727401:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219870.727471:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6240 going to sleep for 11 seconds 00000100:00100000:3.0:1785219870.730341:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465102976 00000100:00100000:3.0:1785219870.730356:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465102976 00000100:00100000:3.0:1785219870.730427:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219870.730437:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1871938465102976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785219870.730727:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1871938465102976:12345-0@lo:1000:mdt00_001.0 Request processed in 291us (3324us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1785219870.730735:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219870.732211:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1871938465102976:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1785219870.732260:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732270:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732668:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732679:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219870.732690:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732699:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732715:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219870.732718:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219870.732723:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732730:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cd3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732770:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732777:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732784:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732789:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219870.732792:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732799:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732806:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf34a6a9500) 00010000:00010000:3.0:1785219870.732809:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219870.732817:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732824:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cc6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732847:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732862:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732872:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732911:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.732926:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 16 pid: 5795 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.732939:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381772680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465103104:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219870.733453:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf245350240 going to sleep for 11 seconds 00000100:00100000:1.0:1785219870.736427:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219870.736860:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381772680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465103104:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219870.736886:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.736915:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444109824 00000100:00100000:3.0:1785219870.736921:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444109824 00010000:00010000:3.0:1785219870.736964:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 17 pid: 5795 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219870.737052:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1785219870.737062:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:2362:x1871938444109824:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219870.737078:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219870.737086:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 17 pid: 5795 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.737100:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 17 pid: 5795 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.737124:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cc86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f3d9 expref: 17 pid: 5795 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.737138:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf34a6a9500) 00010000:00010000:3.0:1785219870.737142:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.737153:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.737160:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.737187:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219870.737240:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:2362:x1871938444109824:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 178us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219870.737248:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00010000:00010000:2.0:1785219870.737302:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737310:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737324:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737332:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737340:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737346:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219870.737350:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737358:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737392:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf34a6a9500) 00010000:00010000:2.0:1785219870.737395:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219870.737400:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737406:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737427:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737433:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737439:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737444:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219870.737447:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737453:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737462:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf34a6a9500) 00010000:00010000:2.0:1785219870.737464:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785219870.737467:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.737473:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cd35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219870.737674:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:10450:x1871938444109568:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 19065us (19252us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1785219870.737683:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000020:00080000:2.0:1785219870.737687:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1785219870.737794:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219870.737800:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219870.737854:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1785219870.737861:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785219870.741720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219870.741881:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444110080 00000100:00100000:2.0:1785219870.741892:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444110080 00000100:00100000:2.0:1785219870.741965:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:2.0:1785219870.741975:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:10450:x1871938444110080:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1785219870.742723:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1785219870.742841:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1785219870.742894:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.742910:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.742922:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.742931:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.742938:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.742946:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219870.742982:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785219870.743068:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:10450:x1871938444110080:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1093us (1355us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1785219870.743078:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000020:00080000:2.0:1785219870.743084:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785219870.743157:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219870.743172:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.743181:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219870.743185:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.743194:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.743207:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf345fcd300) 00010000:00010000:3.0:1785219870.743210:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785219870.743215:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.743222:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cd4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219870.743239:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219870.743241:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219870.743242:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219871.087633:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219871.659810:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465103232:0@lo:400:kworker.0 00000100:00100000:3.0:1785219871.659828:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465103616:0@lo:400:kworker.0 00000100:00100000:1.0:1785219871.659967:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465103360:0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.660958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219871.661017:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465103744:0@lo:400:kworker.0 00000100:00100000:3.0:1785219871.661071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219871.661130:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219871.661177:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465103488:0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.661205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219871.661467:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465103744 00000100:00100000:2.0:1785219871.661475:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465103744 00000100:00100000:2.0:1785219871.661524:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465103488 00000100:00100000:2.0:1785219871.661527:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465103488 00000100:00100000:2.0:1785219871.661560:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1785219871.661569:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465103744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.661620:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465103744:12345-0@lo:400:kworker.0 Request processed in 52us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219871.661627:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1785219871.661643:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1785219871.661659:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465103488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.661690:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465103488:12345-0@lo:400:kworker.0 Request processed in 41us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219871.661696:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1785219871.661715:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219871.661745:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465103488:0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.661773:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465103744:0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.661805:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465103616 00000100:00100000:2.0:1785219871.661808:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465103616 00000100:00100000:2.0:1785219871.661836:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785219871.661852:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465103616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.661884:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465103616:12345-0@lo:400:kworker.0 Request processed in 33us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219871.661889:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1785219871.661906:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219871.662393:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465103232 00000100:00100000:0.0:1785219871.662399:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465103232 00000100:00100000:3.0:1785219871.662423:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465103616:0@lo:400:kworker.0 00000100:00100000:0.0:1785219871.662432:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1785219871.662441:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465103232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219871.662549:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465103232:12345-0@lo:400:kworker.0 Request processed in 108us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219871.662556:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1785219871.668065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219871.668133:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465103872:0@lo:400:kworker.0 00000100:00100000:1.0:1785219871.668176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219871.668400:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465103232:0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.668409:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465103360 00000100:00100000:2.0:1785219871.668417:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465103360 00000100:00100000:2.0:1785219871.668472:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1785219871.668481:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465103360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219871.668914:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465103360:12345-0@lo:400:kworker.0 Request processed in 68us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219871.668923:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1785219871.669395:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465103872 00000100:00100000:0.0:1785219871.669402:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465103872 00000100:00100000:0.0:1785219871.669448:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785219871.669457:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465103872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219871.669518:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465103872:12345-0@lo:400:kworker.0 Request processed in 62us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219871.669524:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785219871.669673:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465103360:0@lo:400:kworker.0 00000100:00100000:1.0:1785219871.669687:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465103872:0@lo:400:kworker.0 00000100:00100000:3.0:1785219871.768576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219871.768655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219871.768695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219871.768727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219871.768755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219871.768798:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444110720 00000100:00100000:3.0:1785219871.768806:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444110720 00000100:00100000:3.0:1785219871.768861:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444110336 00000100:00100000:3.0:1785219871.768864:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444110336 00000100:00100000:3.0:1785219871.768888:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1785219871.768898:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444110720:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219871.768977:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444110720:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219871.768984:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:3.0:1785219871.769000:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:3.0:1785219871.769007:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:2362:x1871938444110336:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219871.769038:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:2362:x1871938444110336:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219871.769122:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:3.0:1785219871.769146:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444110464 00000100:00100000:3.0:1785219871.769149:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444110464 00000100:00100000:3.0:1785219871.769175:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444110592 00000100:00100000:3.0:1785219871.769177:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444110592 00000100:00100000:3.0:1785219871.769200:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1785219871.769207:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444110464:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219871.769437:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444110464:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 229us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219871.769443:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1785219871.769456:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:3.0:1785219871.769462:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444110592:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219871.769485:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444110592:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219871.769497:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00080000:3.0:1785219871.769515:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785219871.769519:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219871.770849:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444110208 00000100:00100000:2.0:1785219871.770860:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444110208 00000100:00100000:2.0:1785219871.770963:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 284 00000100:00100000:2.0:1785219871.770982:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444110208:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219871.771046:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2362:x1871938444110208:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 75us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219871.771053:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 284 00010000:00010000:0.0:1785219872.108550:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219872.177390:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465104000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219872.177461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219872.177557:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465104000 00000100:00100000:3.0:1785219872.177564:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465104000 00000100:00100000:3.0:1785219872.177621:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1785219872.177630:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465104000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219872.177669:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219872.186658:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465104000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9020us (9187us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219872.186673:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1785219872.186709:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785219872.187175:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465104000:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1785219872.584393:0:11899:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785219872.584402:0:11899:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785219872.584441:0:11899:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1785219872.584447:0:11899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785219872.717284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219872.717548:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444110976 00000100:00100000:3.0:1785219872.717558:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444110976 00000100:00100000:3.0:1785219872.717609:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1785219872.717620:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:10468:x1871938444110976:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219872.717639:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219872.717662:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cd51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f411 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.717901:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.717916:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.717928:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219872.717960:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1785219872.718127:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cd51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f411 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.718143:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f411 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.718151:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219872.718154:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785219872.718157:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06600, rc 0) 00000100:00100000:3.0:1785219872.718317:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:10468:x1871938444110976:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 698us (1052us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1785219872.718324:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1785219872.721894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219872.721972:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444111104 00000100:00100000:2.0:1785219872.721983:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444111104 00000100:00100000:2.0:1785219872.722057:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:2.0:1785219872.722067:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:10468:x1871938444111104:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1785219872.722157:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722175:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722186:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722201:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722209:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722216:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722679:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722689:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722698:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219872.722737:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722749:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722766:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722772:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722778:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219872.722782:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722790:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722801:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:2.0:1785219872.722804:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219872.722809:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722814:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cd66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722828:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722834:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722841:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722846:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219872.722855:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722861:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722868:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf345fcd500) 00010000:00010000:2.0:1785219872.722870:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219872.722873:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722879:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cd6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722893:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722899:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722904:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722909:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219872.722912:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722918:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722930:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219872.722932:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219872.722950:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.722957:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cd74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219872.723037:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:10468:x1871938444111104:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 971us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219872.723047:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1785219872.773920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219872.773970:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444111360 00000100:00100000:3.0:1785219872.773979:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444111360 00000100:00100000:3.0:1785219872.774038:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1785219872.774049:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:10471:x1871938444111360:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219872.774069:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219872.774089:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cd7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f418 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774160:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774175:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774197:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774213:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774220:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774225:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774724:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774734:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774741:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219872.774751:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1785219872.774842:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774850:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774857:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774862:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219872.774872:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774880:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774891:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219872.774894:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219872.774898:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774904:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078cd82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774916:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774922:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774928:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774933:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219872.774949:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774956:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774963:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf356788100) 00010000:00010000:3.0:1785219872.774965:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219872.774975:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.774981:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cd89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.775025:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078cd7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.775039:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.775047:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:3.0:1785219872.775049:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219872.775052:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:3.0:1785219872.775121:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10471:x1871938444111360:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1073us (1208us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1785219872.775129:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1785219872.782635:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219872.782674:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444111488 00000100:00100000:0.0:1785219872.782683:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444111488 00000100:00100000:0.0:1785219872.782739:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:0.0:1785219872.782750:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10471:x1871938444111488:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:0.0:1785219872.782814:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782831:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782843:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782878:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782886:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782893:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782899:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219872.782925:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782933:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782954:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:0.0:1785219872.782957:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785219872.782961:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.782967:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078cd9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219872.783037:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10471:x1871938444111488:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 288us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219872.783045:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1785219872.788034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219872.788085:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444111744 00000100:00100000:2.0:1785219872.788095:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444111744 00000100:00100000:2.0:1785219872.788149:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:2.0:1785219872.788159:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10471:x1871938444111744:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785219872.788494:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:10471:x1871938444111744:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 334us (467us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1785219872.788503:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000040:00080000:2.0:1785219872.812579:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219872.812589:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219872.812620:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1785219872.812627:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785219872.821653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.821787:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444112000 00000100:00100000:1.0:1785219872.821804:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444112000 00000100:00100000:1.0:1785219872.821887:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1785219872.821899:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:9993:x1871938444112000:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219872.821930:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219872.821961:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cda5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f41f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.822080:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.822095:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.822104:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.822137:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.822170:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 23 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219872.822185:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381172a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465104128:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219872.822284:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37eb14600 going to sleep for 11 seconds 00000100:00100000:3.0:1785219872.824691:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381172a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465104128:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219872.824728:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219872.825488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.826037:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444112128 00000100:00100000:1.0:1785219872.826066:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444112128 00010000:00010000:1.0:1785219872.826115:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 24 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219872.826160:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:1.0:1785219872.826169:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:2359:x1871938444112128:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219872.826184:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219872.826190:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 24 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.826203:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 24 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.826224:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cd90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f418 expref: 24 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.826241:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:1.0:1785219872.826247:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.826288:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.826295:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.826321:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219872.826586:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:2359:x1871938444112128:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 415us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219872.826594:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00010000:00010000:3.0:1785219872.827301:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.827311:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219872.827339:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1785219872.827602:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078cda5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.827620:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.827627:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:3.0:1785219872.827630:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785219872.827634:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28c00, rc 0) 00000100:00100000:3.0:1785219872.827680:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:9993:x1871938444112000:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5784us (6044us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1785219872.827688:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1785219872.831519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.831629:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444112384 00000100:00100000:1.0:1785219872.831638:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444112384 00000100:00100000:1.0:1785219872.831746:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:1.0:1785219872.831757:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:9993:x1871938444112384:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1785219872.832594:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.832613:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.832626:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219872.832683:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1785219872.832710:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000067fca8f reply state 000000005123046e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219872.832718:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1785219872.832774:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1785219872.832921:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:9993:x1871938444112384:12345-192.168.203.31@tcp:36:bash.0 Request processed in 1163us (1408us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1785219872.832952:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000020:00080000:1.0:1785219872.832957:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1785219872.835817:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.835833:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.835840:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.835854:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29c00 already unused, calling callback (ffffffffc1fcb4f0) 00000100:00100000:3.0:1785219872.835855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:2.0:1785219872.835859:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.835866:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.835894:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:2.0:1785219872.835907:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219872.835912:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219872.835919:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078cdba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219872.836058:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444112512 00000100:00100000:1.0:1785219872.836067:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444112512 00000100:00100000:1.0:1785219872.836603:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:1.0:1785219872.836613:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:9993:x1871938444112512:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219872.836635:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219872.836653:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cdc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f426 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.836709:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cdc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f426 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.836724:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cdc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f426 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.836743:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:1.0:1785219872.836746:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785219872.836749:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29000, rc 0) 00000100:00100000:1.0:1785219872.836805:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:9993:x1871938444112512:12345-192.168.203.31@tcp:101:bash.0 Request processed in 194us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219872.836812:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 90 00000100:00100000:0.0:1785219872.839255:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219872.839479:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444112640 00000100:00100000:3.0:1785219872.839489:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444112640 00000100:00100000:3.0:1785219872.839558:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:3.0:1785219872.839567:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:9993:x1871938444112640:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219872.839582:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219872.839601:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f42d expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785219872.839626:0:8158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a684b1c, atime: 0x6a684b1b, ctime: 0x6a684b1c, blocks: 0xb 00010000:00010000:3.0:1785219872.839646:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1785219872.839651:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219872.839673:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.839691:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.839705:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030c00, rc 0) 00000100:00100000:3.0:1785219872.839763:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:9993:x1871938444112640:12345-192.168.203.31@tcp:101:bash.0 Request processed in 198us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219872.839769:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00080000:0.0:1785219872.839835:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219872.845434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.845496:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444112768 00000100:00100000:1.0:1785219872.845505:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444112768 00002000:00010000:1.0:1785219872.845552:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1785219872.845558:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381770e00 with x1871938444112768 ext(0->18446744073709551615) 00002000:00010000:1.0:1785219872.845569:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381770e00. 00000100:00100000:1.0:1785219872.845619:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1785219872.845629:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2359:x1871938444112768:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:1.0:1785219872.845898:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1785219872.845902:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1785219868 -> 1785219872 00002000:00010000:1.0:1785219872.845905:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1785219867 -> 1785219867 00002000:00010000:1.0:1785219872.845907:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1785219868 -> 1785219872 00002000:00010000:1.0:1785219872.845909:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1785219872.852876:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381770e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2359:x1871938444112768:12345-192.168.203.31@tcp:10:bash.0 Request processed in 7236us (7440us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1785219872.852890:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00010000:1.0:1785219872.852904:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1785219872.852908:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381770e00 with x1871938444112768 ext(0->18446744073709551615) 00002000:00010000:1.0:1785219872.852918:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381770e00. 00000100:00100000:2.0:1785219872.902213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219872.902403:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444112896 00000100:00100000:0.0:1785219872.902414:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444112896 00000100:00100000:0.0:1785219872.902596:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:0.0:1785219872.902607:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:10486:x1871938444112896:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:0.0:1785219872.902686:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.902705:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.902732:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.902749:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.902757:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.902763:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903078:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903088:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903095:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785219872.903132:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903143:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903149:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903154:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903170:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219872.903175:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903182:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903194:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:0.0:1785219872.903196:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219872.903201:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903206:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cdcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903217:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903223:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903228:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903232:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219872.903235:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903241:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903259:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf342843600) 00010000:00010000:0.0:1785219872.903261:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219872.903276:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903281:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cdd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903297:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903303:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903308:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903313:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219872.903316:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903322:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903340:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:0.0:1785219872.903342:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219872.903345:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219872.903350:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078cddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219872.903917:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:10486:x1871938444112896:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1309us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219872.903927:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:2.0:1785219872.941577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.941669:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444113152 00000100:00100000:1.0:1785219872.941680:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444113152 00000100:00100000:1.0:1785219872.941742:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:1.0:1785219872.941752:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:10489:x1871938444113152:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219872.941775:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219872.941796:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cde4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f434 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.941867:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.941881:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.941909:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.941924:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.941932:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.941947:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942536:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cdf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942548:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942557:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219872.942569:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1785219872.942670:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942678:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942685:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942692:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219872.942703:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942710:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942721:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219872.942724:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219872.942729:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942735:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078cdeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942749:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942754:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942760:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942765:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219872.942768:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942773:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942779:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf34a6a9000) 00010000:00010000:1.0:1785219872.942781:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219872.942791:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942796:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cdf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942837:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cde4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f434 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942852:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f434 expref: 29 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.942859:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:1.0:1785219872.942861:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785219872.942863:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28e00, rc 0) 00000100:00100000:1.0:1785219872.942926:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:10489:x1871938444113152:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1176us (1358us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1785219872.942934:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:1.0:1785219872.946511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219872.946583:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444113280 00000100:00100000:3.0:1785219872.946592:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444113280 00000100:00100000:3.0:1785219872.946640:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:3.0:1785219872.946650:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:10489:x1871938444113280:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1785219872.946717:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.946733:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.946742:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.946776:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.946788:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 29 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219872.946815:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465104256:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219872.946901:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219872.954905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.955004:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444113536 00000100:00100000:1.0:1785219872.955014:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444113536 00000100:00100000:1.0:1785219872.955077:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1785219872.955086:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:5574:x1871938444113536:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785219872.955451:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:5574:x1871938444113536:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 364us (557us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1785219872.955457:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:3.0:1785219872.956249:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381772d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465104256:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219872.956288:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219872.957830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.958068:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444113664 00000100:00100000:1.0:1785219872.958077:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444113664 00010000:00010000:1.0:1785219872.958129:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 31 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219872.958169:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1785219872.958178:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:2361:x1871938444113664:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219872.958193:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219872.958199:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 31 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.958211:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 31 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.958232:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cdac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f41f expref: 31 pid: 5793 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.958249:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:1.0:1785219872.958254:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.958263:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.958603:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219872.958634:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219872.958687:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:2361:x1871938444113664:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 509us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219872.958695:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00010000:00010000:3.0:1785219872.959337:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959347:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959683:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959692:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959699:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959706:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219872.959710:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959718:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959731:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:3.0:1785219872.959743:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785219872.959748:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219872.959754:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219872.959825:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:10489:x1871938444113280:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 13175us (13321us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219872.959834:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1785219872.963119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219872.963195:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444113920 00000100:00100000:1.0:1785219872.963204:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444113920 00000100:00100000:1.0:1785219872.963262:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1785219872.963280:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:10489:x1871938444113920:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219872.963543:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:10489:x1871938444113920:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 272us (431us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1785219872.963550:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1785219873.054800:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.054901:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444114176 00000100:00100000:1.0:1785219873.054912:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444114176 00000100:00100000:1.0:1785219873.054993:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1785219873.055004:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:10500:x1871938444114176:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1785219873.055038:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.055070:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078ce0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f43b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055145:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055160:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055172:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055187:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055194:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055220:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055767:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078ce23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055778:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078ce23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055787:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078ce23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219873.055798:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1785219873.055904:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055912:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055919:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055925:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219873.055929:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055946:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055959:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219873.055962:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219873.055974:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055980:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.055994:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056000:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056005:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056010:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219873.056013:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056018:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056025:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf34a6a9000) 00010000:00010000:1.0:1785219873.056026:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219873.056029:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056033:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056132:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078ce0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f43b expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056159:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078ce23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f43b expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.056167:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:1.0:1785219873.056169:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219873.056172:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29600, rc 0) 00000100:00100000:1.0:1785219873.056243:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:10500:x1871938444114176:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1241us (1454us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1785219873.056251:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00080000:0.0:1785219873.057016:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219873.062829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.062978:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444114432 00000100:00100000:1.0:1785219873.062988:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444114432 00000100:00100000:1.0:1785219873.063179:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1785219873.063193:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:10500:x1871938444114432:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:1.0:1785219873.063771:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:10500:x1871938444114432:12345-192.168.203.31@tcp:35:cat.0 Request processed in 580us (948us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1785219873.063780:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1785219873.078562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.078964:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444114688 00000100:00100000:0.0:1785219873.078974:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444114688 00000100:00100000:0.0:1785219873.079097:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1785219873.079108:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:10501:x1871938444114688:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:0.0:1785219873.079164:0:8055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1785219873.079193:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078ce23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f43b expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079213:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cdf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f434 expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079226:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cdc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f426 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079235:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf356788000) 00010000:00010000:0.0:1785219873.079246:0:8055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785219873.079278:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079291:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079301:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079330:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079337:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079345:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079981:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.079993:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.080000:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785219873.081827:0:8055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1785219873.081842:0:8055:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365934477663ns, next at 366934474788ns, rc = 0 00010000:00010000:0.0:1785219873.081917:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.081934:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.081955:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.081963:0:8055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.081984:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.081991:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082445:0:8055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219873.082475:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082483:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082489:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082495:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219873.082499:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082507:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082520:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843900) 00010000:00010000:0.0:1785219873.082524:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785219873.082528:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082534:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078ce3f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082555:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082569:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082575:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082581:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219873.082584:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082590:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082599:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:0.0:1785219873.082601:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219873.082604:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.082610:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ce31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785219873.082620:0:8055:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002798b321 reply state 00000000cbe61fcb transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219873.082629:0:8055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785219873.082726:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:10501:x1871938444114688:12345-192.168.203.31@tcp:36:rm.0 Request processed in 3616us (4169us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1785219873.082734:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00010000:00010000:0.0:1785219873.087882:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.087921:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.087929:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.087944:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219873.087950:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.087957:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.087974:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf342843600) 00010000:00010000:0.0:1785219873.087978:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219873.087983:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.087988:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078ce38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.089276:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219873.089289:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.089298:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219873.089302:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.089310:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.089343:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf342843900) 00010000:00010000:1.0:1785219873.089346:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785219873.089350:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.089356:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078ce46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.089563:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219873.089565:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219873.089567:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219873.131606:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219873.134273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.134629:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444114944 00000100:00100000:3.0:1785219873.134640:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444114944 00000100:00100000:3.0:1785219873.134705:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:3.0:1785219873.134716:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:10507:x1871938444114944:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219873.134740:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219873.134762:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f442 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.134889:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.134903:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.134914:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.134928:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.134945:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.134967:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785219873.138922:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1785219873.139826:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139845:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139858:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139897:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139920:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139927:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139933:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219873.139947:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139955:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139968:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:2.0:1785219873.139971:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219873.139977:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.139983:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078ce54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219873.139999:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6a85b9f reply state 00000000e78f72f1 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.140007:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785219873.140342:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ce4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.140534:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.140558:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219873.140561:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219873.140564:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80e00, rc 0) 00000100:00100000:2.0:1785219873.140644:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:10507:x1871938444114944:12345-192.168.203.31@tcp:101:bash.0 Request processed in 5929us (6384us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1785219873.140653:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00010000:00010000:3.0:1785219873.143829:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.143846:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.143853:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.143859:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.143863:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.143871:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.143887:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf356788500) 00010000:00010000:3.0:1785219873.143890:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219873.143896:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.143902:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078ce5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.144770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.144832:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444115072 00000100:00100000:3.0:1785219873.144841:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444115072 00000100:00100000:3.0:1785219873.144909:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:3.0:1785219873.144919:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381562450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2359:x1871938444115072:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219873.144962:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219873.144984:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f449 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785219873.145009:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785219873.145027:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1785219873.145032:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219873.145042:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.145060:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.145074:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030400, rc 0) 00000100:00100000:3.0:1785219873.145129:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381562450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2359:x1871938444115072:12345-192.168.203.31@tcp:101:bash.0 Request processed in 212us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.145137:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00080000:0.0:1785219873.145398:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785219873.148161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.148552:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444115200 00000100:00100000:3.0:1785219873.148562:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444115200 00000100:00100000:3.0:1785219873.148618:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1785219873.148627:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:10507:x1871938444115200:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219873.148645:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219873.148662:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f450 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.148694:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 9 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.148715:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785219873.148719:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219873.148725:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.148761:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 9 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.148776:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 9 pid: 6589 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.148791:0:8158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381772680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8158:1871938465104384:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219873.148911:0:8158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785219873.152346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.152961:0:8158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381772680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8158:1871938465104384:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219873.152992:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.153013:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:0.0:1785219873.153133:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444115328 00000100:00100000:0.0:1785219873.153139:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444115328 00010000:00010000:0.0:1785219873.153171:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 10 pid: 6589 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219873.153246:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1785219873.153255:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2361:x1871938444115328:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219873.153293:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219873.153316:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 10 pid: 6589 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.153329:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 10 pid: 6589 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.153355:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e24becfa/0x8b38d407a078ce70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f449 expref: 10 pid: 6589 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.153543:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:10507:x1871938444115200:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4916us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.153551:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00010000:00010000:0.0:1785219873.154409:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219873.154414:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219873.154423:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 8 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.154435:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 8 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.154474:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 8 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219873.154488:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381775c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5780:1871938465104512:192.168.203.31@tcp:105: 00000100:00100000:0.0:1785219873.154557:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219873.158724:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381775c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5780:1871938465104512:192.168.203.31@tcp:105: 00010000:00010000:0.0:1785219873.158752:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219873.158823:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444115328:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 5567us (6486us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.158833:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1785219873.160865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.160929:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444115584 00000100:00100000:0.0:1785219873.160945:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444115584 00000100:00100000:0.0:1785219873.161001:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1785219873.161011:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:10507:x1871938444115584:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:0.0:1785219873.161411:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:10507:x1871938444115584:12345-192.168.203.31@tcp:35:bash.0 Request processed in 400us (552us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1785219873.161419:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000001:00080000:3.0:1785219873.270714:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1785219873.270749:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1785219873.270756:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1785219873.317073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.317262:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444115712 00000100:00100000:2.0:1785219873.317328:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444115712 00000100:00100000:2.0:1785219873.317417:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:2.0:1785219873.317428:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:10523:x1871938444115712:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219873.317454:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219873.317474:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ce7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f457 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.317554:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078ce85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.317570:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078ce85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.317584:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078ce85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219873.317641:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1785219873.317646:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219873.317667:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078ce85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.317690:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078ce7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f457 expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.317709:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078ce85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f457 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.317718:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:2.0:1785219873.317732:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785219873.317736:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:2.0:1785219873.317801:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:10523:x1871938444115712:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 375us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.317809:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:3.0:1785219873.321184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.321280:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444115968 00000100:00100000:1.0:1785219873.321290:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444115968 00000100:00100000:1.0:1785219873.321394:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1785219873.321405:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:10523:x1871938444115968:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219873.321425:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.321444:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f45e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.321537:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.321552:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.321563:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219873.321574:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785219873.321690:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078ce8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f45e expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.321737:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f45e expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.321747:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:1.0:1785219873.321751:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219873.321754:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28200, rc 0) 00000100:00100000:1.0:1785219873.321811:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:10523:x1871938444115968:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 408us (635us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1785219873.321819:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:3.0:1785219873.324486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.326686:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444116352 00000100:00100000:0.0:1785219873.326700:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444116352 00000100:00100000:0.0:1785219873.326795:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1785219873.326806:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:2359:x1871938444116352:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219873.326821:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219873.326846:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078ce93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f45e expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.326867:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:0.0:1785219873.326872:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219873.326930:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:2359:x1871938444116352:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 126us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.326948:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1785219873.335407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.335499:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444116224 00000100:00100000:2.0:1785219873.335508:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444116224 00000100:00100000:2.0:1785219873.335567:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1785219873.335576:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:10523:x1871938444116224:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219873.335599:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219873.335617:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f465 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.335709:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.335733:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.335744:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219873.335756:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1785219873.335872:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f465 expref: 39 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.335892:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f465 expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.335901:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219873.335905:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785219873.335908:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81600, rc 0) 00000100:00100000:2.0:1785219873.335977:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:10523:x1871938444116224:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 401us (617us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1785219873.335984:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:3.0:1785219873.343993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.344094:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444116480 00000100:00100000:2.0:1785219873.344116:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444116480 00000100:00100000:2.0:1785219873.344176:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1785219873.344188:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444116480:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:2.0:1785219873.344230:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.344249:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 6 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.344259:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219873.344263:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219873.344268:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.344303:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 6 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.344317:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 6 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.344332:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6589:1871938465104640:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219873.344451:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6240 going to sleep for 11 seconds 00000100:00100000:2.0:1785219873.348481:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6589:1871938465104640:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219873.348510:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.348852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.348942:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444116608 00000100:00100000:1.0:1785219873.348949:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444116608 00002000:00100000:1.0:1785219873.348991:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cf381772a00 x1871938444116608/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:489/0 lens 504/0 e 0 to 0 dl 1785219884 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219873.349001:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381772a00 with x1871938444116608 ext(0->8) 00010000:00010000:1.0:1785219873.349009:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 7 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.349022:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 7 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785219873.349029:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf381772a00 00000100:00100000:1.0:1785219873.349055:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1785219873.349064:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444116608:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:1.0:1785219873.349567:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2362:x1871938444116608:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 502us (715us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1785219873.349579:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00002000:00100000:1.0:1785219873.349588:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cf381772a00 x1871938444116608/t4294967302(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:489/0 lens 504/448 e 0 to 0 dl 1785219884 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219873.349597:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381772a00 with x1871938444116608 ext(0->8) 00010000:00010000:1.0:1785219873.349603:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.349616:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785219873.349624:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf381772a00 00000100:00100000:3.0:1785219873.356159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.356261:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444116736 00000100:00100000:1.0:1785219873.356280:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444116736 00010000:00010000:1.0:1785219873.356320:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219873.356441:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:1.0:1785219873.356452:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444116736:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219873.356467:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1785219873.356486:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785219873.356489:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785219872 00002000:00010000:1.0:1785219873.356491:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785219872 00002000:00010000:1.0:1785219873.356494:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1785219872 00010000:00010000:1.0:1785219873.356501:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.356533:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.356561:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011394a33/0x8b38d407a078ce77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f450 expref: 9 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.356581:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785219873.356585:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785219873.356591:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.356602:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.356626:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219873.356680:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444116736:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 229us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219873.356688:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00010000:00010000:2.0:1785219873.356760:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356771:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356794:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356804:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356813:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356820:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219873.356824:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356834:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356847:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.356866:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000111e751e/0x8b38d407a078ceb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.356915:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444116480:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 12729us (12931us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.356924:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1785219873.361156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.361240:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444116992 00000100:00100000:0.0:1785219873.361249:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444116992 00000100:00100000:0.0:1785219873.361316:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:0.0:1785219873.361326:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:10523:x1871938444116992:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:0.0:1785219873.361434:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f465 expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785219873.361661:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1785219873.361702:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1785219873.362146:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1785219873.362196:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.362211:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.362220:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.362251:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.362265:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 42 pid: 5794 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219873.362279:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381775c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1871938465104768:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785219873.362709:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219873.366659:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381775c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1871938465104768:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785219873.366688:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.367575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.367648:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444117120 00000100:00100000:0.0:1785219873.367668:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444117120 00010000:00010000:0.0:1785219873.367701:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 43 pid: 5794 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219873.367753:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1785219873.367762:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+43:2362:x1871938444117120:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219873.367776:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219873.367784:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 43 pid: 5794 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.367797:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 43 pid: 5794 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.367820:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078ce62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f442 expref: 43 pid: 5794 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.367837:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:0.0:1785219873.367842:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.367853:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.367861:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.367890:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219873.367950:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+42:2362:x1871938444117120:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 188us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.367967:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00010000:00010000:1.0:1785219873.368127:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.368136:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219873.368251:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1785219873.368488:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1785219873.368588:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465104896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785219873.368639:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219873.368665:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37eb14840 going to sleep for 11 seconds 00000100:00100000:0.0:1785219873.369257:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465104896 00000100:00100000:0.0:1785219873.369271:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465104896 00000100:00100000:0.0:1785219873.369316:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785219873.369325:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1871938465104896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785219873.369415:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1871938465104896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.369423:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785219873.369600:0:5796:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1785219873.369605:0:5796:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1785219873.369623:0:5796:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf348a3ce00, transno 4294967301 00000100:00100000:1.0:1785219873.369634:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465104896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785219873.370305:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1785219873.370409:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465105024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785219873.370444:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219873.370467:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37eb149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219873.370837:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465105024 00000100:00100000:0.0:1785219873.370843:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465105024 00000100:00100000:0.0:1785219873.370882:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785219873.370888:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1871938465105024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785219873.371063:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1871938465105024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 175us (617us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1785219873.371071:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219873.371194:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1871938465105024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1785219873.371238:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1785219873.371283:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.371293:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.371301:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.371308:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219873.371313:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.371321:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.371336:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219873.371347:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1785219873.371352:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.371359:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cebd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785219873.371533:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1785219873.371605:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1785219873.371614:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366224249902ns, next at 367224248326ns, rc = 0 00000001:00080000:2.0:1785219873.371620:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1785219873.371651:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219873.371654:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785219873.371661:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cea8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f465 expref: 46 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.371914:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+45:10523:x1871938444116992:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 10588us (10766us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1785219873.371923:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000020:00080000:2.0:1785219873.371927:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1785219873.374098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.374171:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444117248 00000100:00100000:3.0:1785219873.374193:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444117248 00000100:00100000:3.0:1785219873.374249:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:3.0:1785219873.374259:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+45:10523:x1871938444117248:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219873.374290:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219873.374312:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f46c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.374489:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f46c expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.374505:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f46c expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.374526:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.374530:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219873.374533:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031200, rc 0) 00000100:00100000:3.0:1785219873.374581:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+46:10523:x1871938444117248:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 324us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.374588:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:0.0:1785219873.385164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.388060:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444117504 00000100:00100000:1.0:1785219873.388075:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444117504 00000100:00100000:0.0:1785219873.389921:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1785219873.389943:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+46:10523:x1871938444117504:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785219873.390198:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:10523:x1871938444117504:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 264us (5042us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1785219873.390206:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:2.0:1785219873.473328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.473433:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444117632 00000100:00100000:3.0:1785219873.473443:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444117632 00000100:00100000:3.0:1785219873.473501:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:3.0:1785219873.473511:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:10533:x1871938444117632:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1785219873.473588:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473607:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473636:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473650:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473656:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473662:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473767:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473775:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473781:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219873.473822:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473835:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473842:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473848:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473865:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.473869:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473877:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473890:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219873.473893:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219873.473897:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473904:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473917:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473923:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473929:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473948:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.473951:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473957:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473976:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf356788500) 00010000:00010000:3.0:1785219873.473979:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219873.473982:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.473988:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078ced2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.474004:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.474010:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.474016:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.474021:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.474024:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.474029:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.474035:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.474037:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219873.474040:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.474045:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078ced9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.474138:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:10533:x1871938444117632:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 627us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.474145:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:3.0:1785219873.510257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.510414:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444117888 00000100:00100000:1.0:1785219873.510425:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444117888 00000100:00100000:1.0:1785219873.510487:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:1.0:1785219873.510497:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:10536:x1871938444117888:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219873.510519:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.510540:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f473 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510612:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510626:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510637:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510669:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510677:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510684:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510820:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510829:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510836:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219873.510847:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785219873.510949:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510957:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510964:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510971:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219873.510975:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.510993:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511005:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219873.511008:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219873.511013:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511020:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cee7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511034:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511040:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511045:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511050:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219873.511053:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511058:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511066:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf34a6a9800) 00010000:00010000:1.0:1785219873.511068:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219873.511071:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511086:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078ceee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511126:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f473 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511140:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f473 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.511147:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219873.511150:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219873.511152:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29200, rc 0) 00000100:00100000:1.0:1785219873.511218:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+49:10536:x1871938444117888:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 722us (970us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1785219873.511225:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:1.0:1785219873.513631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.513705:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444118016 00000100:00100000:3.0:1785219873.513712:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444118016 00000100:00100000:3.0:1785219873.513781:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:3.0:1785219873.513791:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+49:10536:x1871938444118016:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1785219873.513856:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513872:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513884:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513907:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513914:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513921:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513926:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.513930:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513965:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513977:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.513980:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785219873.513985:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.513991:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.514070:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+49:10536:x1871938444118016:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 281us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.514077:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 103 00000100:00100000:2.0:1785219873.515767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.515836:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444118272 00000100:00100000:1.0:1785219873.515843:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444118272 00000100:00100000:1.0:1785219873.515893:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:1.0:1785219873.515903:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+49:10536:x1871938444118272:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219873.516134:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:10536:x1871938444118272:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 232us (373us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1785219873.516141:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:2.0:1785219873.625310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.625632:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444118528 00000100:00100000:1.0:1785219873.625641:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444118528 00000100:00100000:1.0:1785219873.625693:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:1.0:1785219873.625717:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:10546:x1871938444118528:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219873.625740:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.625743:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785219873.625767:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078ce85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f457 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.625785:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219873.625790:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219873.625801:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f47a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.625885:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.625899:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.625908:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219873.625917:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785219873.626050:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.626062:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.626069:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219873.626072:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219873.626081:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28000, rc 0) 00000100:00100000:1.0:1785219873.626144:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:10546:x1871938444118528:12345-192.168.203.31@tcp:101:bash.0 Request processed in 429us (842us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1785219873.626151:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:2.0:1785219873.630655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.630702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.630889:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444118912 00000100:00100000:3.0:1785219873.630899:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444118912 00000100:00100000:3.0:1785219873.630971:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 105 00000100:00100000:3.0:1785219873.630980:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:10546:x1871938444118912:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:3.0:1785219873.631045:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219873.631081:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078cef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f473 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.631098:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.631103:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219873.631313:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.631327:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219873.631710:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444118656 00000100:00100000:0.0:1785219873.631716:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444118656 00010000:00010000:3.0:1785219873.631827:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00100000:3.0:1785219873.631851:0:5793:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0x8b38d407a078cf11 req@ffff9cf38114f800 x1871938444118656/t0(0) o103->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:489/0 lens 328/0 e 0 to 0 dl 1785219884 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1785219873.631880:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.631894:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 52 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.631908:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465105152:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219873.631998:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785219873.632156:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1785219873.632165:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:2362:x1871938444118656:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219873.632183:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219873.632188:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 52 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.632197:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 52 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.632211:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:0.0:1785219873.632215:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.632222:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.632229:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.632242:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219873.632286:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:2362:x1871938444118656:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 122us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.632294:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00010000:00010000:3.0:1785219873.634659:0:5793:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.31@tcp) returned -22 from blocking AST (req@00000000c1f81c34 x1871938465105152) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 51 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.634683:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078cf11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f47a expref: 51 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.634699:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465105152:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219873.634720:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.634727:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.634735:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.634752:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785219873.634858:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1785219873.634907:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000043d00c6 reply state 0000000033022567 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.634916:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785219873.635030:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:10546:x1871938444118912:12345-192.168.203.31@tcp:36:bash.0 Request processed in 4051us (4327us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1785219873.635038:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 105 00000020:00080000:3.0:1785219873.635044:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785219873.639552:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.639569:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.639576:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.639596:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219873.639601:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.639609:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.639627:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:0.0:1785219873.639631:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219873.639635:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.639641:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.639832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.639984:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444119040 00000100:00100000:1.0:1785219873.639996:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444119040 00000100:00100000:1.0:1785219873.640046:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:1.0:1785219873.640055:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:10546:x1871938444119040:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219873.640077:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.640094:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f481 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.640174:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.640187:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.640197:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219873.640225:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1785219873.640229:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219873.640246:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.640270:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 53 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.640284:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.640300:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219873.640303:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219873.640306:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29e00, rc 0) 00000100:00100000:1.0:1785219873.640515:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:10546:x1871938444119040:12345-192.168.203.31@tcp:101:bash.0 Request processed in 459us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219873.640522:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 106 00000100:00100000:3.0:1785219873.643732:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.645817:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444119296 00000100:00100000:1.0:1785219873.645831:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444119296 00000100:00100000:1.0:1785219873.645883:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1785219873.645892:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:10546:x1871938444119296:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1785219873.646734:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10546:x1871938444119296:12345-192.168.203.31@tcp:35:bash.0 Request processed in 838us (3006us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1785219873.646744:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1785219873.705685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.705784:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444119424 00000100:00100000:0.0:1785219873.705794:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444119424 00000100:00100000:0.0:1785219873.705853:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:0.0:1785219873.705864:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+53:10552:x1871938444119424:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785219873.705888:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219873.705906:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cf34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f488 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.705980:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078cf3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.705995:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.706006:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219873.706075:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1785219873.706078:0:8055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219873.706099:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.706124:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cf34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f488 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.706141:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078cf3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f488 expref: 54 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.706149:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:0.0:1785219873.706152:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785219873.706155:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0000, rc 0) 00000100:00100000:0.0:1785219873.706217:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10552:x1871938444119424:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 355us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.706225:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 107 00000100:00100000:3.0:1785219873.720552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.720718:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444119552 00000100:00100000:2.0:1785219873.720742:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444119552 00000100:00100000:2.0:1785219873.720802:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1785219873.720813:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10552:x1871938444119552:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219873.720835:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219873.720856:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cf42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f48f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.720922:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721119:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721132:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721149:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721157:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721164:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721261:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cf57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721270:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721278:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219873.721322:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1785219873.721326:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219873.721348:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721401:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721411:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721418:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721424:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721430:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219873.721434:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721441:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721453:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:2.0:1785219873.721456:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219873.721461:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721467:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cf49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721492:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721499:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721505:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721511:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219873.721514:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721520:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721529:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf345fcda00) 00010000:00010000:2.0:1785219873.721532:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219873.721536:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721542:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078cf50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721574:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078cf42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f48f expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721590:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cf57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f48f expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.721611:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:2.0:1785219873.721614:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219873.721616:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:2.0:1785219873.721685:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10552:x1871938444119552:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 873us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.721692:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 108 00000100:00100000:2.0:1785219873.730166:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.730214:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.730309:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444119680 00000100:00100000:0.0:1785219873.730319:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444119680 00000100:00100000:0.0:1785219873.730437:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1785219873.730447:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:2361:x1871938444119680:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219873.730464:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219873.730491:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cf57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f48f expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.730513:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:0.0:1785219873.730533:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219873.730584:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:2361:x1871938444119680:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 138us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.730592:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:1.0:1785219873.730735:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444119936 00000100:00100000:1.0:1785219873.730740:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444119936 00000100:00100000:1.0:1785219873.730775:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:1.0:1785219873.730782:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10552:x1871938444119936:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219873.730798:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.730815:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f496 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.730906:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.730919:0:8055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.730945:0:8055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.730976:0:8055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.730988:0:8055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 55 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219873.731002:0:8055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381171180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465105280:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219873.731062:0:8055:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37eb14b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219873.733809:0:8055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381171180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465105280:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219873.733838:0:8055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.735536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.736251:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444120064 00000100:00100000:3.0:1785219873.736263:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444120064 00010000:00010000:3.0:1785219873.736309:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 56 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.736352:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1785219873.736382:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:2362:x1871938444120064:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219873.736398:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219873.736406:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 56 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.736418:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 56 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.736471:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078cf2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f481 expref: 56 pid: 5795 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.736487:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.736492:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.736503:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.736510:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.736542:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219873.736598:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:2362:x1871938444120064:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 236us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.736605:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00010000:00010000:1.0:1785219873.736876:0:8055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.736892:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219873.736910:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1785219873.737068:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 56 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.737083:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.737102:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219873.737105:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219873.737107:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28200, rc 0) 00000100:00100000:1.0:1785219873.737149:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10552:x1871938444119936:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 6367us (6934us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1785219873.737155:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 109 00000100:00100000:2.0:1785219873.741845:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.741960:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444120320 00000100:00100000:0.0:1785219873.741969:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444120320 00000100:00100000:0.0:1785219873.742039:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1785219873.742049:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf350cff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10552:x1871938444120320:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:0.0:1785219873.742070:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219873.742097:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f46c expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.742116:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:0.0:1785219873.742121:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219873.742175:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf350cff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10552:x1871938444120320:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 127us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.742183:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1785219873.747201:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.747335:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444120448 00000100:00100000:3.0:1785219873.747344:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444120448 00000100:00100000:3.0:1785219873.747428:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:3.0:1785219873.747438:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10552:x1871938444120448:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:3.0:1785219873.747569:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.747588:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.747610:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785219873.747819:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1785219873.747907:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10552:x1871938444120448:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 470us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.747915:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 110 00000100:00100000:2.0:1785219873.752289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.752440:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444120576 00000100:00100000:3.0:1785219873.752450:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444120576 00000100:00100000:3.0:1785219873.752503:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 111 00000100:00100000:3.0:1785219873.752513:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:10552:x1871938444120576:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219873.752534:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219873.752555:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f49d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.752610:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.752621:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.752639:0:5793:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.752652:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.752665:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.752669:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219873.752672:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.752696:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030a00, rc 0) 00000100:00100000:3.0:1785219873.752760:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10552:x1871938444120576:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 248us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.752767:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 111 00000040:00080000:2.0:1785219873.835625:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219873.835635:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219873.835673:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1785219873.835681:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785219873.835800:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465105408:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785219873.835896:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a7f6900 going to sleep for 11 seconds 00000100:00100000:2.0:1785219873.851605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.851670:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465105408:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785219873.851982:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444120704 00000100:00100000:3.0:1785219873.852000:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444120704 00000100:00100000:3.0:1785219873.852100:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:3.0:1785219873.852112:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10553:x1871938444120704:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785219873.852158:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785219873.852868:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10553:x1871938444120704:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 754us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.852880:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 112 00000100:00100000:2.0:1785219873.862029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.862161:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444120832 00000100:00100000:3.0:1785219873.862177:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444120832 00000100:00100000:3.0:1785219873.862255:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:3.0:1785219873.862279:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10553:x1871938444120832:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1785219873.862421:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.862443:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.862768:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863137:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863176:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863191:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863225:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863232:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863238:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219873.863285:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1785219873.863290:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219873.863305:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863315:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863322:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863329:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863335:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.863339:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863354:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863399:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:3.0:1785219873.863403:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219873.863408:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863414:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078cf81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863431:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863436:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863441:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863446:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.863448:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863454:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863460:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9cf356788500) 00010000:00010000:3.0:1785219873.863462:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219873.863466:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863481:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078cf88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863498:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863505:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863511:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863515:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219873.863518:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863524:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863534:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219873.863537:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219873.863542:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.863548:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cf8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.863938:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10553:x1871938444120832:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 1649us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.863948:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 113 00000100:00100000:2.0:1785219873.868556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.869013:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444121088 00000100:00100000:1.0:1785219873.869031:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444121088 00000100:00100000:1.0:1785219873.869132:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:1.0:1785219873.869144:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:10553:x1871938444121088:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785219873.869176:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.869206:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4a4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869355:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869403:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869417:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219873.869431:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1785219873.869585:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869595:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869620:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869627:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219873.869632:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869642:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869656:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219873.869659:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785219873.869664:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869670:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cf9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869724:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf96 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4a4 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869737:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:1.0:1785219873.869739:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219873.869743:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cf96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4a4 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.869753:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28400, rc 0) 00000100:00100000:1.0:1785219873.869845:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:10553:x1871938444121088:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 703us (1297us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1785219873.869863:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:2.0:1785219873.879850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.880617:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444121216 00000100:00100000:1.0:1785219873.880630:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444121216 00000100:00100000:1.0:1785219873.880701:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1785219873.880711:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:10553:x1871938444121216:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785219873.880750:0:8055:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785219873.880858:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:10553:x1871938444121216:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 148us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219873.880866:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:2.0:1785219873.888318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.888611:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444121472 00000100:00100000:1.0:1785219873.888622:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444121472 00000100:00100000:1.0:1785219873.888685:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1785219873.888695:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:10553:x1871938444121472:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785219873.888718:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219873.888721:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785219873.888748:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078cf3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f488 expref: 56 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.888767:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219873.888772:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219873.888786:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cfab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4ab expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785219873.890040:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1785219873.890275:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cfb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.890307:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.890318:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.890403:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078cfab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ab expref: 58 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.890420:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cfb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ab expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.890429:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf34a6a9800) 00010000:00010000:1.0:1785219873.890432:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219873.890435:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28c00, rc 0) 00000100:00100000:1.0:1785219873.890506:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:10553:x1871938444121472:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1811us (2197us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1785219873.890514:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1785219873.894476:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.894587:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444121728 00000100:00100000:1.0:1785219873.894597:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444121728 00000100:00100000:1.0:1785219873.894655:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:1.0:1785219873.894664:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:10553:x1871938444121728:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785219873.894755:0:8055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219873.894784:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078cfb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ab expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.894802:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf34a6a9800) 00010000:00010000:1.0:1785219873.894820:0:8055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219873.894841:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.894853:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.894862:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.894921:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.894939:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.894947:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895799:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895811:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895817:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895823:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219873.895827:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895834:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895855:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:1.0:1785219873.895858:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219873.895862:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895869:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078cfc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895880:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895887:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895892:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895897:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219873.895900:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895905:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895911:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xce015341 (ffff9cf34a6a9000) 00010000:00010000:1.0:1785219873.895913:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219873.895916:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219873.895921:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078cfc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xce015341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219873.896191:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:10553:x1871938444121728:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1523us (1720us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785219873.896201:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:2.0:1785219873.899232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219873.899492:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444121856 00000100:00100000:0.0:1785219873.899503:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444121856 00000100:00100000:0.0:1785219873.899794:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:0.0:1785219873.899805:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:10553:x1871938444121856:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785219873.899826:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219873.899992:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cfce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4b2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.900062:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.900075:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.900085:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.900173:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078cfce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.900192:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219873.900201:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219873.900204:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785219873.900207:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1000, rc 0) 00000100:00100000:0.0:1785219873.900453:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:10553:x1871938444121856:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 648us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219873.900461:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:2.0:1785219873.905305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.905715:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444122112 00000100:00100000:3.0:1785219873.905803:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444122112 00000100:00100000:3.0:1785219873.905868:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:3.0:1785219873.905878:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:10553:x1871938444122112:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785219873.905970:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.905987:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.905998:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785219873.907200:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1785219873.907766:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029a51190 reply state 000000000efff0ff transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.907778:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785219873.907941:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:10553:x1871938444122112:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2053us (2633us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1785219873.907950:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00010000:00010000:2.0:1785219873.913409:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.913426:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.913432:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.913438:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219873.913443:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.913449:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.913466:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219873.913469:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785219873.913474:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.913480:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078cfdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.913921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.914006:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444122240 00000100:00100000:2.0:1785219873.914125:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444122240 00000100:00100000:2.0:1785219873.914184:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:2.0:1785219873.914193:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:10553:x1871938444122240:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219873.914214:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219873.914232:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4b9 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.914543:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.914719:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.914743:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219873.914746:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785219873.914749:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:2.0:1785219873.914821:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:10553:x1871938444122240:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 628us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.914829:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 120 00000100:00100000:0.0:1785219873.918838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.918938:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444122368 00000100:00100000:3.0:1785219873.918949:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444122368 00000100:00100000:3.0:1785219873.919272:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:3.0:1785219873.919286:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444122368:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1785219873.919641:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444122368:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 357us (810us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785219873.920803:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1785219873.936115:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.936288:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444122624 00000100:00100000:2.0:1785219873.936299:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444122624 00000100:00100000:2.0:1785219873.936361:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1785219873.936404:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:10553:x1871938444122624:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785219873.936881:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:10553:x1871938444122624:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 479us (774us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1785219873.936904:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1785219873.940028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.940183:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444122880 00000100:00100000:1.0:1785219873.940194:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444122880 00000100:00100000:1.0:1785219873.940263:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:1.0:1785219873.940274:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:10553:x1871938444122880:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785219873.940411:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:10553:x1871938444122880:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 139us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219873.940423:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1785219873.942538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.942721:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444123008 00000100:00100000:2.0:1785219873.942742:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444123008 00000100:00100000:2.0:1785219873.942810:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:2.0:1785219873.942820:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:10553:x1871938444123008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219873.942843:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219873.942873:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cfea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4c0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.942980:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.942995:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.943006:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219873.943753:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219873.943779:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.943807:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078cfea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c0 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.943825:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c0 expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.943833:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219873.943845:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785219873.943849:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81600, rc 0) 00000100:00100000:2.0:1785219873.943903:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:10553:x1871938444123008:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1084us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.943911:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 122 00000100:00100000:0.0:1785219873.947867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.947959:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444123136 00000100:00100000:2.0:1785219873.947971:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444123136 00000100:00100000:2.0:1785219873.948083:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:2.0:1785219873.948094:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444123136:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219873.948112:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219873.948133:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4c7 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785219873.948160:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a684b21, blocks: 0x1 00010000:00010000:2.0:1785219873.948179:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1785219873.948183:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219873.948193:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 10 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.948211:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 10 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.948223:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81800, rc 0) 00000100:00100000:2.0:1785219873.948280:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2361:x1871938444123136:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 188us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.948287:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1785219873.952320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.952489:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444123392 00000100:00100000:1.0:1785219873.952499:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444123392 00000100:00100000:1.0:1785219873.952552:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:1.0:1785219873.952571:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:10553:x1871938444123392:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785219873.952673:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:10553:x1871938444123392:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 112us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219873.952680:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:0.0:1785219873.956054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.956207:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444123520 00000100:00100000:2.0:1785219873.956219:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444123520 00000100:00100000:2.0:1785219873.956285:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1785219873.956296:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:10553:x1871938444123520:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219873.956315:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219873.956334:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4ce expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.956394:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 11 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.956404:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219873.956409:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219873.956414:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 11 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.956446:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 11 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.956461:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 11 pid: 6586 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219873.956475:0:8158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8158:1871938465105536:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219873.956575:0:8158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a0e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219873.960449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219873.960591:0:8158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8158:1871938465105536:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219873.960629:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 11 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219873.960668:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81400, rc 0) 00000100:00100000:2.0:1785219873.960724:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:10553:x1871938444123520:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4430us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219873.960733:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1785219873.961407:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444123648 00000100:00100000:3.0:1785219873.961416:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444123648 00010000:00010000:3.0:1785219873.961455:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 11 pid: 6586 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.961492:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:3.0:1785219873.961501:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:2361:x1871938444123648:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219873.961523:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219873.961547:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 11 pid: 6586 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.961918:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 11 pid: 6586 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.961951:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000111e751e/0x8b38d407a078cff8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c7 expref: 11 pid: 6586 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.961965:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219873.961969:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219873.961976:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 10 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.961985:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 10 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219873.962034:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 10 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219873.962057:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cf0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5778:1871938465105664:192.168.203.31@tcp:105: 00000100:00100000:3.0:1785219873.962136:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219873.968707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219873.968891:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cf0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5778:1871938465105664:192.168.203.31@tcp:105: 00010000:00010000:3.0:1785219873.968917:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219873.969001:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2361:x1871938444123648:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 7501us (8560us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219873.969022:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:1.0:1785219873.969169:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444123776 00000100:00100000:1.0:1785219873.969177:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444123776 00002000:00100000:1.0:1785219873.969219:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cf381775f80 x1871938444123776/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:489/0 lens 504/0 e 0 to 0 dl 1785219884 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219873.969229:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381775f80 with x1871938444123776 ext(0->12) 00002000:00010000:1.0:1785219873.969235:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381775f80 00000100:00100000:1.0:1785219873.969273:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785219873.969289:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2361:x1871938444123776:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1785219873.969741:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:2361:x1871938444123776:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 452us (1042us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1785219873.969748:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:1.0:1785219873.969755:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cf381775f80 x1871938444123776/t4294967308(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:489/0 lens 504/448 e 0 to 0 dl 1785219884 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219873.969764:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381775f80 with x1871938444123776 ext(0->12) 00002000:00010000:1.0:1785219873.969768:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381775f80 00000100:00100000:0.0:1785219873.974765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219873.975632:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444123904 00000100:00100000:1.0:1785219873.975643:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444123904 00000100:00100000:1.0:1785219873.975724:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:1.0:1785219873.975736:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:10553:x1871938444123904:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1785219874.052758:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967389 is committed 00000004:00080000:2.0:1785219874.052782:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1785219874.052794:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:2.0:1785219874.052816:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf37eb14840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1785219874.052821:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37f027a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf37eb14900 00000020:00080000:2.0:1785219874.052824:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37f027c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf381fbd400 00000001:00080000:2.0:1785219874.052860:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1785219874.052869:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1785219874.052906:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf351fb6000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1785219874.052909:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf3487b0900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf351fb6e40 00000020:00080000:2.0:1785219874.052911:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf3487b0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf36ced5800 00000020:00080000:2.0:1785219874.052916:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1785219874.052955:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1785219874.053351:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1785219874.053684:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:10553:x1871938444123904:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 77945us (78925us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219874.053694:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 124 00000100:00100000:3.0:1785219874.054083:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465105792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785219874.054142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219874.054214:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785219874.054221:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465105920:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785219874.054245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219874.054359:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465105792 00000100:00100000:1.0:1785219874.054387:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465105792 00000100:00100000:1.0:1785219874.054435:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465105920 00000100:00100000:1.0:1785219874.054438:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465105920 00000100:00100000:1.0:1785219874.054461:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785219874.054470:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465105792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785219874.054495:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1785219874.054529:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a684b20, atime: 0x6a684b20, ctime: 0x6a684b20, blocks: 0x1 00010000:00010000:1.0:1785219874.054537:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.054574:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1785219874.054578:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219874.054584:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.054597:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.054606:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.054614:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.054632:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1785219874.056158:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf38116ce00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1785219874.056169:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465105792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785219874.056208:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785219874.056220:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465105920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785219874.056245:0:6586:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1785219874.056279:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.056300:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 11 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.056309:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785219874.056313:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219874.056317:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.056351:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 11 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.056397:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 11 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.056412:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465106048:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219874.056464:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219874.056612:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cf0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465105792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2142us (2469us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1785219874.056621:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1785219874.056650:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785219874.056654:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785219874.056671:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219874.056678:0:11513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.056687:0:11513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219874.056691:0:11513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.056708:0:11513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.056727:0:11513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.056735:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afa2e6c4/0x8b38d407a078d006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.056756:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219874.056758:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219874.056760:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219874.066429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219874.066537:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444124032 00000100:00100000:1.0:1785219874.066550:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444124032 00000100:00100000:1.0:1785219874.066609:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1785219874.066619:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:2362:x1871938444124032:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1785219874.068014:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219874.068506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219874.068536:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444124160 00000100:00100000:0.0:1785219874.068543:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444124160 00010000:00010000:0.0:1785219874.068577:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 13 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219874.068612:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:0.0:1785219874.068620:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381777100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:2361:x1871938444124160:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219874.068633:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219874.068638:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 13 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.068653:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 13 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.068681:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785219874.068686:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785219874.068692:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.068701:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.068735:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219874.068790:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381777100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:2361:x1871938444124160:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 171us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219874.068797:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00010000:00010000:3.0:1785219874.069937:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078cdc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f42d expref: 12 pid: 8158 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.069961:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465106048:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219874.069983:0:6586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.069995:0:6586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.070003:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.070013:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.070022:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.070070:0:6586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785219874.070704:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465105920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14486us (16455us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1785219874.070714:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1785219874.070792:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf381171180/2, rc 0, transno 4294967309 00000100:00100000:3.0:1785219874.070809:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465105920:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1785219874.071159:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219874.071168:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.071179:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219874.071182:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.071193:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.071212:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.071219:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0af009f/0x8b38d407a078d00d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.071240:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219874.071242:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219874.071244:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785219874.153106:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1785219874.153162:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1785219874.153488:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444124032:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 86866us (87064us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219874.153500:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00010000:00010000:3.0:1785219874.155831:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219874.156178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219874.159086:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444124416 00000100:00100000:1.0:1785219874.159101:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444124416 00000100:00100000:0.0:1785219874.161558:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1785219874.161572:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:10553:x1871938444124416:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785219874.161630:0:8055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219874.161663:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81600/0x8b38d407a078cff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4c0 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.161684:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219874.161689:0:8055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785219874.161720:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.162478:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.162490:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785219874.162950:0:8055:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000510a7d6c reply state 00000000d6c7ee03 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219874.167968:0:8055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785219874.168109:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:10553:x1871938444124416:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 6535us (11932us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1785219874.168118:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 125 00000100:00100000:0.0:1785219874.172478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00010000:00010000:3.0:1785219874.172557:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.172570:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.172578:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.172584:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219874.172589:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.172597:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.172614:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219874.172618:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219874.172622:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.172628:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d014 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219874.172716:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444124544 00000100:00100000:1.0:1785219874.172739:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444124544 00000100:00100000:1.0:1785219874.172789:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:1.0:1785219874.172799:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444124544:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1785219874.173036:0:8158:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1785219874.173040:0:8158:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785219873 00002000:00010000:1.0:1785219874.173042:0:8158:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1785219872 00002000:00010000:1.0:1785219874.173045:0:8158:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1785219873 -> 1785219873 00002000:00010000:1.0:1785219874.173048:0:8158:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1785219874.173107:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444124544:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 309us (638us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1785219874.173116:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1785219874.175819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219874.175907:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444124800 00000100:00100000:0.0:1785219874.175918:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444124800 00000100:00100000:0.0:1785219874.175986:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1785219874.175996:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:10553:x1871938444124800:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1785219874.176077:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.176095:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.176105:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.176144:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.176159:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 15 pid: 5794 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219874.176175:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381776300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465106176:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785219874.176265:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219874.187851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219874.188163:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444124928 00000100:00100000:1.0:1785219874.188175:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444124928 00010000:00010000:1.0:1785219874.188217:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 16 pid: 5794 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219874.188267:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1785219874.188277:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:2362:x1871938444124928:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219874.188294:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219874.188303:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 16 pid: 5794 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.188317:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 16 pid: 5794 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.188344:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219874.188349:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.188359:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.188428:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.188450:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219874.188504:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:2362:x1871938444124928:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 228us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219874.188512:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00010000:00010000:2.0:1785219874.188894:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078cfd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b2 expref: 15 pid: 5794 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219874.188912:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381776300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465106176:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219874.188943:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.188962:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.188969:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.189002:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.189010:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.189017:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.189024:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219874.189029:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.189038:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.189049:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219874.189052:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1785219874.189057:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.189064:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d01b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219874.189131:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:10553:x1871938444124800:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 13136us (13323us total) trans 0 rc -22/-22 00000100:00100000:2.0:1785219874.189146:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 126 00000100:00100000:0.0:1785219874.192186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219874.192280:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444125056 00000100:00100000:3.0:1785219874.192289:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444125056 00000100:00100000:3.0:1785219874.192346:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1785219874.192356:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444125056:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1785219874.192450:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.192471:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.192481:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785219874.192485:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219874.192491:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.192531:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.192546:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 7 pid: 8158 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.192562:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465106304:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219874.192637:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a0e7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785219874.196746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219874.196848:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444125184 00000100:00100000:1.0:1785219874.196859:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444125184 00010000:00010000:1.0:1785219874.196901:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 8 pid: 8158 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.196916:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465106304:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219874.196953:0:6586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219874.196955:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1785219874.196964:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444125184:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219874.196981:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219874.197003:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 8 pid: 8158 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.197016:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 8 pid: 8158 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.197038:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8b3d02/0x8b38d407a078cfff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ce expref: 8 pid: 8158 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.197054:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785219874.197058:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785219874.197070:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.197080:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.197109:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219874.197164:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444125184:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 200us (426us total) trans 0 rc 0/0 00010000:00010000:3.0:1785219874.197165:0:6586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219874.197179:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00010000:00010000:3.0:1785219874.197183:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.197211:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.197221:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.197229:0:6586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.197238:0:6586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219874.197242:0:6586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.197259:0:6586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.197274:0:6586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.197294:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060573f00/0x8b38d407a078d022 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.197593:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444125056:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 5237us (5415us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219874.197603:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:0.0:1785219874.202947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219874.203208:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444125440 00000100:00100000:2.0:1785219874.203218:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444125440 00000100:00100000:2.0:1785219874.203312:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 127 00000100:00100000:2.0:1785219874.203323:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:10553:x1871938444125440:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785219874.203441:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.203457:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.203470:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.203688:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.203699:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.203708:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.203742:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.203757:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 15 pid: 5795 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219874.203791:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3812f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465106432:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219874.203873:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219874.207456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219874.207712:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444125568 00000100:00100000:1.0:1785219874.207721:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444125568 00010000:00010000:1.0:1785219874.207765:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 16 pid: 5795 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219874.207808:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1785219874.207817:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:2361:x1871938444125568:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219874.207832:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219874.207838:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 16 pid: 5795 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.207851:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 16 pid: 5795 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.207872:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219874.207877:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.207902:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.207910:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.208487:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219874.208655:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:2361:x1871938444125568:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 837us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219874.208664:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00010000:00010000:3.0:1785219874.208707:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078cfe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4b9 expref: 15 pid: 5795 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.208725:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3812f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465106432:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219874.208746:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.208755:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.208760:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785219874.208965:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1785219874.209118:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1785219874.209166:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1785219874.209249:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465106560:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785219874.209298:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219874.209334:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6540 going to sleep for 11 seconds 00000100:00100000:0.0:1785219874.209567:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465106560 00000100:00100000:0.0:1785219874.209574:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465106560 00000100:00100000:0.0:1785219874.209668:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219874.209678:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5793:x1871938465106560:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785219874.209773:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5793:x1871938465106560:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219874.209780:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785219874.209885:0:5793:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1785219874.209891:0:5793:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1785219874.209920:0:5793:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9cf381171180 x1871938465105920/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785219890 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219874.209942:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465106560:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1785219874.210772:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1785219874.210849:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465106688:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785219874.210889:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219874.210912:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6240 going to sleep for 11 seconds 00000100:00100000:1.0:1785219874.210920:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465106688 00000100:00100000:1.0:1785219874.210945:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465106688 00000100:00100000:1.0:1785219874.210974:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785219874.210980:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3812f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5793:x1871938465106688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785219874.213880:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3812f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5793:x1871938465106688:12345-0@lo:1000:mdt00_000.0 Request processed in 2891us (2981us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1785219874.213894:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785219874.214081:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465106688:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1785219874.214129:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214139:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214146:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214152:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219874.214156:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214164:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214180:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219874.214183:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219874.214187:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214193:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d030 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214242:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214249:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214254:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214260:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219874.214263:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214269:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214278:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219874.214281:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219874.214287:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214299:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214307:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219874.214356:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.214403:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465106816:192.168.203.31@tcp:105: 00000100:00100000:3.0:1785219874.214483:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a0e7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219874.220747:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465106944:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1785219874.220767:0:6630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367073401701ns, next at 368073398993ns, rc = 0 00000100:00100000:1.0:1785219874.220812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219874.220875:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465106944 00000100:00100000:3.0:1785219874.220883:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465106944 00000100:00100000:0.0:1785219874.220944:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36dc01180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465106816:192.168.203.31@tcp:105: 00000100:00100000:3.0:1785219874.220951:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785219874.220963:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465106944:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785219874.220973:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1785219874.220986:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00010000:00010000:0.0:1785219874.220986:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078cf73 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221022:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221038:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221051:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.221053:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465106944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219874.221066:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1785219874.221082:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221090:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221096:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221103:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219874.221106:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221113:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221123:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:0.0:1785219874.221138:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219874.221142:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221148:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d037 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221160:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221166:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221173:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221178:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219874.221181:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221187:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221195:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:0.0:1785219874.221197:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785219874.221200:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.221205:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d029 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219874.221444:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:10553:x1871938444125440:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 18122us (18517us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1785219874.221461:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 127 00000020:00080000:0.0:1785219874.221465:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1785219874.221513:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785219874.221529:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1785219874.224056:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465106944:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1785219874.225131:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1785219874.225153:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785219874.226242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219874.226328:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444125696 00000100:00100000:3.0:1785219874.226336:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444125696 00000100:00100000:3.0:1785219874.226476:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:3.0:1785219874.226486:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:10552:x1871938444125696:12345-192.168.203.31@tcp:49:lfs.0 00000100:00100000:3.0:1785219874.226616:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:10552:x1871938444125696:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 132us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219874.226623:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:0.0:1785219874.229916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219874.232001:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444125952 00000100:00100000:2.0:1785219874.232014:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444125952 00000100:00100000:2.0:1785219874.232092:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1785219874.232101:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:10553:x1871938444125952:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1785219874.232763:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1785219874.232850:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1785219874.232899:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.232913:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.232924:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.232942:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.232949:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.232955:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.232979:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785219874.233074:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:10553:x1871938444125952:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 973us (3165us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1785219874.233083:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000020:00080000:2.0:1785219874.233088:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785219874.233336:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219874.233344:0:11513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.233352:0:11513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219874.233356:0:11513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.233391:0:11513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.233404:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf345fcdd00) 00010000:00010000:0.0:1785219874.233407:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785219874.233411:0:11513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.233417:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d03e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219874.233433:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219874.233434:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219874.233436:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219874.233525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219874.234972:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444126208 00000100:00100000:2.0:1785219874.234983:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444126208 00000100:00100000:2.0:1785219874.235040:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:2.0:1785219874.235048:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:10552:x1871938444126208:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:2.0:1785219874.235284:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1785219874.235715:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:10552:x1871938444126208:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 664us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219874.235723:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 128 00000100:00100000:0.0:1785219874.279875:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219874.279989:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444126336 00000100:00100000:2.0:1785219874.280000:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444126336 00000100:00100000:2.0:1785219874.280058:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 129 00000100:00100000:2.0:1785219874.280076:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:10555:x1871938444126336:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219874.280101:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219874.280122:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4d5 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280185:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280199:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280228:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280243:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280250:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280257:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280607:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280618:0:8055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 21 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280625:0:8055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280657:0:8055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 21 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.280671:0:8055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 21 pid: 8055 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219874.280684:0:8055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465107072:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219874.280771:0:8055:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4780 going to sleep for 11 seconds 00000100:00100000:1.0:1785219874.309842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219874.309953:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444126592 00000100:00100000:0.0:1785219874.309962:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444126592 00000100:00100000:0.0:1785219874.310020:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1785219874.310043:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:5573:x1871938444126592:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785219874.310294:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:5573:x1871938444126592:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 252us (461us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1785219874.310302:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:2.0:1785219874.310627:0:8055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465107072:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219874.310651:0:8055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219874.312671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219874.312774:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444126720 00000100:00100000:1.0:1785219874.312794:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444126720 00010000:00010000:1.0:1785219874.312833:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 23 pid: 8055 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219874.312878:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1785219874.312887:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:2362:x1871938444126720:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219874.312912:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219874.312919:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 23 pid: 8055 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.312943:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 23 pid: 8055 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.312969:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078cf65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f496 expref: 23 pid: 8055 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.312984:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219874.312989:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.313000:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.313007:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219874.313042:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219874.313228:0:8055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313237:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219874.313280:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1785219874.313285:0:8055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219874.313305:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313317:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313326:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313344:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313352:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313358:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219874.313400:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313408:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313427:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:2.0:1785219874.313430:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219874.313434:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313570:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d04c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313585:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313592:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313598:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313604:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219874.313607:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313614:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313623:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf345fcde00) 00010000:00010000:2.0:1785219874.313626:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219874.313629:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313635:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313686:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4d5 expref: 23 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313700:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4d5 expref: 22 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219874.313708:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:2.0:1785219874.313710:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219874.313713:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f80a00, rc 0) 00000100:00100000:1.0:1785219874.313865:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:2362:x1871938444126720:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 976us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219874.313875:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:2.0:1785219874.319718:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10555:x1871938444126336:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 39638us (39839us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219874.319731:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 129 00010000:00010000:0.0:1785219875.184080:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785219875.195582:0:11952:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219875.197567:0:11952:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219875.197659:0:11952:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1785219875.197665:0:11952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1785219875.243581:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785219875.243591:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785219875.243650:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1785219875.243661:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785219875.243786:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465107200:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785219875.243884:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348705900 going to sleep for 11 seconds 00000100:00100000:3.0:1785219875.247136:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465107200:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785219875.254565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219875.254696:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444126848 00000100:00100000:3.0:1785219875.254707:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444126848 00000100:00080000:1.0:1785219875.254774:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219875.254778:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:3.0:1785219875.254788:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10566:x1871938444126848:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785219875.254888:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785219875.255030:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10566:x1871938444126848:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 243us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219875.255040:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 130 00000100:00100000:3.0:1785219875.259696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219875.260896:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444127104 00000100:00100000:1.0:1785219875.260908:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444127104 00000100:00100000:1.0:1785219875.260987:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:1.0:1785219875.261014:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:10566:x1871938444127104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785219875.261037:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219875.261057:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d061 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219875.261161:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219875.261175:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219875.261186:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219875.261197:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1785219875.261314:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d061 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4dc expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219875.261332:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4dc expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219875.261341:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219875.261344:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219875.261347:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29800, rc 0) 00000100:00100000:1.0:1785219875.261428:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:10566:x1871938444127104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 416us (1740us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1785219875.261435:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:1.0:1785219875.267819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219875.267913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219875.268009:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444127232 00000100:00100000:2.0:1785219875.268019:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444127232 00000100:00100000:2.0:1785219875.268087:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1785219875.268096:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:2362:x1871938444127232:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219875.268110:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219875.268133:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4dc expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219875.268152:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:2.0:1785219875.268157:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219875.268213:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:2362:x1871938444127232:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 118us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219875.268221:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1785219875.269660:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444127488 00000100:00100000:3.0:1785219875.269670:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444127488 00000100:00100000:3.0:1785219875.269719:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:3.0:1785219875.269727:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:10566:x1871938444127488:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1785219875.269802:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.269819:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.269831:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.270196:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.270213:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.270220:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.270226:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219875.270230:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.270237:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.270250:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219875.270321:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785219875.270328:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219875.270336:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d076 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219875.270798:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:10566:x1871938444127488:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 1068us (2985us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1785219875.270808:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000040:00080000:3.0:1785219875.270953:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785219875.270958:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785219875.271974:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1785219875.271990:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785219875.275518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219875.275591:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444127744 00000100:00100000:2.0:1785219875.275600:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444127744 00000100:00100000:2.0:1785219875.275656:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1785219875.275665:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:10566:x1871938444127744:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785219875.275888:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:10566:x1871938444127744:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 223us (379us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1785219875.275896:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00010000:00010000:3.0:1785219876.203975:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219876.780253:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465107328:0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.780323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219876.780384:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465107840:0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.780413:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219876.780438:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219876.780444:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465107712:0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.780469:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219876.780504:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465107328 00000100:00100000:0.0:1785219876.780523:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465107328 00000100:00100000:0.0:1785219876.780566:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1785219876.780576:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465107328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.780626:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465107328:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219876.780633:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1785219876.780664:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465107840 00000100:00100000:0.0:1785219876.780669:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465107840 00000100:00100000:0.0:1785219876.780935:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1785219876.780943:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465107840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.780977:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465107840:12345-0@lo:400:kworker.0 Request processed in 36us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219876.780994:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1785219876.781015:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219876.781045:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465107328:0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.781058:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465107840:0@lo:400:kworker.0 00000100:00100000:3.0:1785219876.782985:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465107456:0@lo:400:kworker.0 00000100:00100000:3.0:1785219876.783178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219876.783240:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465107968:0@lo:400:kworker.0 00000100:00100000:3.0:1785219876.783268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219876.783297:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785219876.783304:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465107584:0@lo:400:kworker.0 00000100:00100000:3.0:1785219876.783326:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219876.785856:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465107712 00000100:00100000:3.0:1785219876.785868:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465107712 00000100:00100000:3.0:1785219876.785931:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465107968 00000100:00100000:3.0:1785219876.785935:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465107968 00000100:00080000:0.0:1785219876.785939:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219876.785943:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785219876.785961:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785219876.785970:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465107712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.786123:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465107712:0@lo:400:kworker.0 00000100:00100000:3.0:1785219876.786172:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465107712:12345-0@lo:400:kworker.0 Request processed in 202us (5700us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219876.786180:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785219876.786198:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1785219876.786204:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465107968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219876.786257:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465107968:12345-0@lo:400:kworker.0 Request processed in 53us (2988us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219876.786263:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785219876.786405:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465107968:0@lo:400:kworker.0 00000100:00100000:2.0:1785219876.786789:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465107456 00000100:00100000:2.0:1785219876.786796:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465107456 00000100:00100000:2.0:1785219876.786833:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465107584 00000100:00100000:2.0:1785219876.786836:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465107584 00000100:00100000:2.0:1785219876.786868:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1785219876.786874:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465107456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.786890:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1785219876.786898:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465107584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219876.786933:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465107456:12345-0@lo:400:kworker.0 Request processed in 58us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219876.786939:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1785219876.786940:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465107584:12345-0@lo:400:kworker.0 Request processed in 44us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219876.786946:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1785219876.786970:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465107584:0@lo:400:kworker.0 00000100:00100000:0.0:1785219876.786981:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465107456:0@lo:400:kworker.0 00000100:00080000:1.0:1785219876.787218:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219876.891070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219876.891102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219876.891122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219876.891142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219876.891209:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219876.891236:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444127872 00000100:00100000:2.0:1785219876.891245:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444127872 00000100:00100000:2.0:1785219876.891289:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:2.0:1785219876.891298:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444127872:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219876.891391:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444127872:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219876.891399:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 286 00000100:00100000:2.0:1785219876.891430:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444128000 00000100:00100000:2.0:1785219876.891434:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444128000 00000100:00100000:2.0:1785219876.891457:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444128384 00000100:00100000:2.0:1785219876.891460:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444128384 00000100:00100000:2.0:1785219876.891487:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1785219876.891493:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:2361:x1871938444128000:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219876.891526:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:2361:x1871938444128000:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219876.891532:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 131 00000100:00100000:2.0:1785219876.891545:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:2.0:1785219876.891551:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444128384:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219876.891574:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2362:x1871938444128384:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219876.891580:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 132 00000100:00100000:2.0:1785219876.891597:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444128256 00000100:00100000:2.0:1785219876.891601:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444128256 00000100:00100000:2.0:1785219876.891622:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444128128 00000100:00100000:2.0:1785219876.891625:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444128128 00000100:00100000:2.0:1785219876.891643:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1785219876.891649:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444128256:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219876.891675:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444128256:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219876.891691:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:2.0:1785219876.891703:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:2.0:1785219876.891709:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444128128:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219876.891736:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444128128:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219876.891742:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00080000:2.0:1785219876.891839:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785219876.891843:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219876.891846:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1785219877.031359:0:12003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219877.031381:0:12003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219877.031423:0:12003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1785219877.031427:0:12003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785219877.186246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219877.192441:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444128640 00000100:00100000:3.0:1785219877.192455:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444128640 00000100:00100000:3.0:1785219877.194493:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00100000:3.0:1785219877.194509:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:10587:x1871938444128640:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219877.194532:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219877.194554:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d07d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4e3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219877.194668:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d084 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219877.194685:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d084 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219877.194697:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d084 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219877.194709:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1785219877.194849:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d07d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4e3 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219877.194871:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d084 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4e3 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219877.194880:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219877.194883:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1785219877.194886:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031200, rc 0) 00000100:00100000:3.0:1785219877.194965:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:10587:x1871938444128640:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 461us (8740us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1785219877.194972:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 133 00000100:00080000:1.0:1785219877.199048:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219877.206405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219877.206439:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444128768 00000100:00100000:1.0:1785219877.206448:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444128768 00000100:00100000:1.0:1785219877.206498:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 134 00000100:00100000:1.0:1785219877.206507:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:10587:x1871938444128768:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1785219877.206575:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206591:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206603:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206630:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206636:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206643:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206649:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219877.206653:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206661:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206686:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:1.0:1785219877.206689:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219877.206693:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219877.206699:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219877.208221:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:10587:x1871938444128768:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 1706us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219877.208233:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 134 00010000:00010000:1.0:1785219877.228555:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219877.293348:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785219877.293390:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465108096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219877.293470:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219877.296422:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108096 00000100:00100000:3.0:1785219877.296438:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108096 00000100:00100000:3.0:1785219877.296493:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785219877.296504:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465108096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219877.296542:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219877.296666:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465108096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219877.296674:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1785219877.296934:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465108096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219877.333139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219877.333308:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444128896 00000100:00100000:2.0:1785219877.333318:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444128896 00000100:00100000:2.0:1785219877.333413:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1785219877.333424:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444128896:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:2.0:1785219877.333443:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219877.333463:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df108a3d/0x8b38d407a078d099 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4ea expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785219877.333489:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a684b21, atime: 0x6a684b20, ctime: 0x6a684b21, blocks: 0xb 00010000:00010000:2.0:1785219877.333509:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1785219877.333514:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219877.333539:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df108a3d/0x8b38d407a078d099 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ea expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219877.333559:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df108a3d/0x8b38d407a078d099 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ea expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219877.333573:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf354f81600, rc 0) 00000100:00100000:2.0:1785219877.333626:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444128896:12345-192.168.203.31@tcp:101:cat.0 Request processed in 204us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219877.333633:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:1.0:1785219877.343779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219877.344252:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444129024 00000100:00100000:3.0:1785219877.344264:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444129024 00002000:00100000:3.0:1785219877.344316:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9cf381170000 x1871938444129024/t0(0) o3->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:493/0 lens 488/0 e 0 to 0 dl 1785219888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785219877.344328:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381170000 with x1871938444129024 ext(0->4095) 00002000:00010000:3.0:1785219877.344335:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381170000 00000100:00100000:1.0:1785219877.344393:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:3.0:1785219877.344400:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1785219877.344406:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444129024:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:3.0:1785219877.344408:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1785219877.344634:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444129024:12345-192.168.203.31@tcp:3:cat.0 Request processed in 230us (876us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1785219877.344641:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:1.0:1785219877.344647:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9cf381170000 x1871938444129024/t0(0) o3->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:493/0 lens 488/4536 e 0 to 0 dl 1785219888 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219877.344664:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381170000 with x1871938444129024 ext(0->4095) 00002000:00010000:1.0:1785219877.344668:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381170000 00010000:00010000:0.0:1785219878.252399:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785219878.423449:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1785219878.423476:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1785219878.423484:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1785219879.279882:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785219879.339689:0:6630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372192322229ns, next at 373192319953ns, rc = 0 00000100:00100000:0.0:1785219879.339721:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465108224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219879.339784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219879.340158:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108224 00000100:00100000:1.0:1785219879.340166:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108224 00000100:00100000:1.0:1785219879.340220:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785219879.340229:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465108224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219879.340273:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219879.340322:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465108224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219879.340330:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1785219879.340352:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219879.340415:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465108224:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1785219879.404020:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:2.0:1785219879.404057:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:2.0:1785219879.404081:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1785219879.404089:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1785219879.404491:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1785219879.404506:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:2.0:1785219879.404526:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1785219879.404951:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1785219879.404963:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000020:00080000:2.0:1785219879.405250:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf351fb6540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1785219879.405261:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf34898bc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf351fb66c0 00000020:00080000:2.0:1785219879.405265:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf34898b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf37e9c7400 00000020:00080000:2.0:1785219879.405407:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:1.0:1785219879.405594:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219879.405623:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465108352:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1785219879.405697:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1785219879.405706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219879.405743:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108352 00000100:00100000:2.0:1785219879.405754:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108352 00000100:00100000:2.0:1785219879.405837:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785219879.405863:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465108352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1785219879.406341:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1785219879.406346:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1785219873 -> 1785219873 00002000:00010000:2.0:1785219879.406348:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1785219872 -> 1785219872 00002000:00010000:2.0:1785219879.406350:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1785219873 -> 1785219873 00002000:00010000:2.0:1785219879.406352:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1785219879.406472:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1871938465108352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 625us (769us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1785219879.406482:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785219879.406920:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1785219879.406928:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf381171180, transno 4294967309 00000004:00080000:1.0:1785219879.406946:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1785219879.406975:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9cf381777100 x1871938465108352/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1785219895 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1785219879.406988:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf381777100/2, rc 0, transno 4294967312 00000100:00100000:1.0:1785219879.406994:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465108352:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1785219880.299669:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219881.324585:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219881.550118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219881.550340:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444129152 00000100:00100000:3.0:1785219881.550357:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444129152 00000100:00100000:2.0:1785219881.550685:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00100000:2.0:1785219881.550701:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:10232:x1871938444129152:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1785219881.550850:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:10232:x1871938444129152:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 153us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219881.550859:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 135 00000100:00080000:1.0:1785219881.551007:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219881.553580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219881.554331:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444129408 00000100:00100000:1.0:1785219881.554345:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444129408 00000100:00100000:1.0:1785219881.554465:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:1.0:1785219881.554477:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:10232:x1871938444129408:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785219881.555527:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:10232:x1871938444129408:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1956us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1785219881.555538:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1785219881.795553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219881.796019:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444129536 00000100:00100000:1.0:1785219881.796033:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444129536 00000100:00100000:1.0:1785219881.796223:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:1.0:1785219881.796236:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:11040:x1871938444129536:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:1.0:1785219881.796265:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219881.796295:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4f1 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219881.796429:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219881.796445:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219881.796460:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219881.796724:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1785219881.796730:0:8055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219881.796830:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219881.796864:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 7 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219881.796897:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 6 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219881.796908:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:1.0:1785219881.796912:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785219881.796924:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28e00, rc 0) 00000100:00080000:0.0:1785219881.797089:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219881.797698:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:11040:x1871938444129536:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 1460us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219881.797709:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:0.0:1785219881.899793:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465108864:0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.900088:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465108608:0@lo:400:kworker.0 00000100:00100000:3.0:1785219881.900154:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465108480:0@lo:400:kworker.0 00000100:00100000:2.0:1785219881.900321:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465108736:0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.900528:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219881.900601:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465109120:0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.900641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219881.900702:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108608 00000100:00100000:1.0:1785219881.900712:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108608 00000100:00100000:1.0:1785219881.900925:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1785219881.900935:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465108608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.901005:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465108608:12345-0@lo:400:kworker.0 Request processed in 71us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219881.901012:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1785219881.901075:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465108608:0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.901118:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465109120 00000100:00100000:1.0:1785219881.901122:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465109120 00000100:00100000:1.0:1785219881.901168:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1785219881.901175:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465109120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.901216:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465109120:12345-0@lo:400:kworker.0 Request processed in 42us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219881.901223:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1785219881.901246:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1785219881.901252:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1785219881.901271:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf38116ce00, transno 4294967304 00000100:00100000:1.0:1785219881.901303:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465109120:0@lo:400:kworker.0 00000100:00080000:1.0:1785219881.901327:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785219881.902452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219881.902517:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465108992:0@lo:400:kworker.0 00000100:00100000:3.0:1785219881.902552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219881.902709:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108480 00000100:00100000:1.0:1785219881.902716:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108480 00000100:00100000:1.0:1785219881.902779:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1785219881.902789:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465108480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.902851:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465108480:12345-0@lo:400:kworker.0 Request processed in 64us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219881.902859:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1785219881.903135:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108992 00000100:00100000:1.0:1785219881.903140:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108992 00000100:00100000:1.0:1785219881.903178:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1785219881.903185:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465108992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.903224:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465108992:12345-0@lo:400:kworker.0 Request processed in 40us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219881.903230:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1785219881.903248:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219881.903337:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465108480:0@lo:400:kworker.0 00000100:00100000:3.0:1785219881.903352:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465108992:0@lo:400:kworker.0 00000100:00100000:0.0:1785219881.904613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219881.905144:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108864 00000100:00100000:3.0:1785219881.905155:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108864 00000100:00100000:3.0:1785219881.905242:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1785219881.905272:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465108864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219881.905395:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465108864:12345-0@lo:400:kworker.0 Request processed in 126us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219881.905404:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1785219881.905491:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219881.905583:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465108864:0@lo:400:kworker.0 00000100:00100000:2.0:1785219881.905842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219881.906028:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465108736 00000100:00100000:1.0:1785219881.906034:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465108736 00000100:00100000:1.0:1785219881.906095:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1785219881.906105:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465108736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219881.906153:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465108736:12345-0@lo:400:kworker.0 Request processed in 50us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219881.906159:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1785219881.906220:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219881.906268:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465108736:0@lo:400:kworker.0 00000100:00100000:0.0:1785219882.009991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219882.010045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219882.010083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219882.010130:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219882.010174:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444129920 00000100:00100000:3.0:1785219882.010175:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444129792 00000100:00100000:0.0:1785219882.010186:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444129920 00000100:00100000:3.0:1785219882.010187:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444129792 00000100:00100000:0.0:1785219882.010263:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444130048 00000100:00100000:0.0:1785219882.010267:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444130048 00000100:00100000:3.0:1785219882.010273:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:3.0:1785219882.010289:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:2359:x1871938444129792:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219882.010300:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1785219882.010311:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2359:x1871938444129920:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219882.010424:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444129664 00000100:00100000:2.0:1785219882.010429:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444129664 00000100:00100000:2.0:1785219882.010460:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:2.0:1785219882.010468:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444129664:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219882.010566:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2359:x1871938444129920:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 257us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219882.010576:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:0.0:1785219882.010596:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1785219882.010602:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444130048:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:1.0:1785219882.012082:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785219882.012097:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219882.016168:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:2359:x1871938444129792:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 5861us (6061us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219882.016172:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444129664:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 5700us (6193us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219882.016195:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 136 00000100:00100000:2.0:1785219882.016213:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 288 00000100:00100000:0.0:1785219882.021842:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444130048:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 11216us (11688us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219882.021865:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:0.0:1785219882.347715:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219882.412091:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219882.412351:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465109248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219882.412472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219882.412939:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465109248 00000100:00100000:1.0:1785219882.412951:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465109248 00000100:00100000:1.0:1785219882.413057:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785219882.413069:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465109248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219882.413114:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219882.413183:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465109248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219882.413191:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785219882.413290:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465109248:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1785219882.480048:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785219882.480201:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785219882.480618:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1785219882.480627:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1785219883.371662:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219884.398245:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219884.461282:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465109376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219884.461397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219884.461490:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465109376 00000100:00100000:0.0:1785219884.461501:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465109376 00000100:00100000:0.0:1785219884.461575:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1785219884.461587:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465109376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785219884.461635:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219884.461700:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465109376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (302us total) trans 0 rc 0/0 00000100:00080000:1.0:1785219884.461701:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219884.461712:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1785219884.461777:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465109376:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1785219884.513404:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1785219884.515040:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1785219884.515060:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1785219884.515170:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1785219884.515193:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1785219885.421194:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785219885.684561:0:12209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:24:43 (1785219883) 00010000:00010000:1.0:1785219886.444879:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219886.874497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219886.874817:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444130304 00000100:00100000:2.0:1785219886.874828:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444130304 00000100:00100000:2.0:1785219886.874914:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:2.0:1785219886.874925:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:11306:x1871938444130304:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219886.874946:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219886.874967:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d0ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4f8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875046:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875060:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875087:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875102:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875109:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875116:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785219886.875189:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785219886.875676:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d0c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875687:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875694:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219886.875704:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1785219886.875919:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875927:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875934:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875940:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219886.875944:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875951:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875963:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf356788700) 00010000:00010000:2.0:1785219886.875966:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219886.875970:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875985:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81400/0x8b38d407a078d0b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.875997:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876003:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876009:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876014:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f80e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219886.876018:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876024:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876031:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf345fcda00) 00010000:00010000:2.0:1785219886.876034:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219886.876037:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876043:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80e00/0x8b38d407a078d0bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876479:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f81800/0x8b38d407a078d0ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f8 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876496:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f8 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219886.876511:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:2.0:1785219886.876514:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219886.876517:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9c00, rc 0) 00000100:00100000:2.0:1785219886.876588:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:11306:x1871938444130304:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1665us (2099us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1785219886.876597:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 137 00000100:00100000:1.0:1785219886.892944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219886.892995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219886.893061:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444130560 00000100:00100000:0.0:1785219886.893072:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444130560 00000100:00100000:0.0:1785219886.893157:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1785219886.893167:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:2360:x1871938444130560:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219886.893183:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219886.893208:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d0c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f8 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219886.893228:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:0.0:1785219886.893233:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219886.893305:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:2360:x1871938444130560:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 140us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219886.893313:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1785219886.893490:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444130432 00000100:00100000:2.0:1785219886.893495:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444130432 00000100:00100000:2.0:1785219886.893552:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:2.0:1785219886.893559:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38116ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:11306:x1871938444130432:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1785219886.893625:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38116ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:11306:x1871938444130432:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 66us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219886.893631:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 138 00000100:00100000:0.0:1785219887.020697:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465109760:0@lo:400:kworker.0 00000100:00100000:0.0:1785219887.020764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219887.020821:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785219887.020828:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465109888:0@lo:400:kworker.0 00000100:00100000:0.0:1785219887.020864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219887.020897:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465109760 00000100:00100000:0.0:1785219887.020904:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465109760 00000100:00100000:0.0:1785219887.020956:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1785219887.020966:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465109760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219887.021015:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465109760:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219887.021022:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1785219887.021059:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465109760:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021191:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465109504:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219887.021260:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465110016:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219887.021306:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785219887.021312:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465109632:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219887.021347:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465110144:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219887.021433:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465109888 00000100:00100000:1.0:1785219887.021437:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465109888 00000100:00100000:1.0:1785219887.021463:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465110144 00000100:00100000:1.0:1785219887.021466:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465110144 00000100:00100000:1.0:1785219887.021485:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1785219887.021490:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465109888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021526:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465109888:12345-0@lo:400:kworker.0 Request processed in 36us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219887.021531:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1785219887.021542:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785219887.021547:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465110144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021579:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465110144:12345-0@lo:400:kworker.0 Request processed in 32us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219887.021585:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785219887.021607:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465110016 00000100:00100000:1.0:1785219887.021611:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465110016 00000100:00100000:1.0:1785219887.021632:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465109632 00000100:00100000:1.0:1785219887.021635:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465109632 00000100:00100000:1.0:1785219887.021650:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1785219887.021656:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465110016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021685:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465110016:12345-0@lo:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219887.021690:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1785219887.021700:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1785219887.021706:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465109632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021729:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465109632:12345-0@lo:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219887.021741:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1785219887.021756:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785219887.021759:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785219887.021762:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219887.021784:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465109632:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021793:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465110144:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021801:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465110016:0@lo:400:kworker.0 00000100:00100000:1.0:1785219887.021825:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1785219887.021831:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf381777100, transno 4294967312 00000100:00100000:1.0:1785219887.021854:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465109888:0@lo:400:kworker.0 00000100:00100000:2.0:1785219887.022216:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465109504 00000100:00100000:2.0:1785219887.022221:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465109504 00000100:00100000:2.0:1785219887.022260:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1785219887.022268:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465109504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219887.022307:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465109504:12345-0@lo:400:kworker.0 Request processed in 41us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219887.022314:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1785219887.022398:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465109504:0@lo:400:kworker.0 00000100:00100000:0.0:1785219887.121075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219887.121117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219887.121217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219887.121251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219887.121281:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444130816 00000100:00100000:0.0:1785219887.121283:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444130688 00000100:00100000:0.0:1785219887.121293:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444130688 00000100:00100000:1.0:1785219887.121297:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444130816 00000100:00100000:1.0:1785219887.121349:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444130944 00000100:00100000:0.0:1785219887.121353:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:1.0:1785219887.121355:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444130944 00000100:00100000:0.0:1785219887.121391:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444130688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219887.121412:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:1.0:1785219887.121423:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444130816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219887.121464:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444130688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219887.121490:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 290 00000100:00100000:0.0:1785219887.121549:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:0.0:1785219887.121557:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444130944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219887.121588:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2361:x1871938444130944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219887.121594:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00080000:0.0:1785219887.121614:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785219887.121618:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219887.121805:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444130816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219887.121816:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:3.0:1785219887.125574:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444131072 00000100:00100000:3.0:1785219887.125588:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444131072 00000100:00100000:3.0:1785219887.125711:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:3.0:1785219887.125721:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2361:x1871938444131072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219887.125804:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2361:x1871938444131072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 84us (4687us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219887.125812:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00080000:0.0:1785219887.128472:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785219887.467551:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219887.531794:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37eb05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465110272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785219887.531876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219887.531950:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465110272 00000100:00100000:1.0:1785219887.531964:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465110272 00000100:00100000:1.0:1785219887.532009:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785219887.532018:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465110272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219887.532051:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219887.532097:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465110272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219887.532104:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785219887.532150:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37eb05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465110272:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1785219887.596774:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785219887.596783:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785219887.596819:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1785219887.596826:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1785219888.491619:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219888.599089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219888.599163:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444131200 00000100:00100000:1.0:1785219888.599173:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444131200 00000100:00100000:1.0:1785219888.599245:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00100000:1.0:1785219888.599255:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:11348:x1871938444131200:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219888.599275:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219888.599295:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d0d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f4ff expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599354:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599392:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599405:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599437:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599445:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599452:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599690:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599697:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599703:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599709:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219888.599714:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599720:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599730:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:1.0:1785219888.599733:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219888.599736:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599741:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d0d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599757:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599763:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599767:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599772:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219888.599774:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599779:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599786:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cf34a6a9300) 00010000:00010000:1.0:1785219888.599788:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219888.599790:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599795:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d0df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599822:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d0d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ff expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599845:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:1.0:1785219888.599848:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219888.599857:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d0d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ff expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.599867:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28000, rc 0) 00000100:00100000:1.0:1785219888.599930:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:11348:x1871938444131200:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 676us (891us total) trans 0 rc 301/301 00000100:00100000:1.0:1785219888.599937:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 139 00000100:00080000:3.0:1785219888.600375:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219888.608583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219888.608652:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444131456 00000100:00100000:3.0:1785219888.608663:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444131456 00000100:00100000:3.0:1785219888.608723:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 140 00000100:00100000:3.0:1785219888.608741:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:11348:x1871938444131456:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1785219888.608797:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219888.608822:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ca4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f338 expref: 14 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.608849:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219888.608854:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219888.609272:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.609288:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 5 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.609296:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.609331:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 5 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.609345:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 5 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219888.609360:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465110400:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219888.609474:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf346f1cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219888.612108:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465110400:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219888.612137:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219888.612691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.612757:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444131584 00000100:00100000:0.0:1785219888.612765:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444131584 00010000:00010000:0.0:1785219888.612799:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 6 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219888.612845:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1785219888.612854:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2361:x1871938444131584:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219888.612867:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219888.612874:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 6 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.612885:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 6 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.612905:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d0a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4f1 expref: 6 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.612939:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:0.0:1785219888.612944:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.612953:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.612961:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.612990:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219888.613039:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2361:x1871938444131584:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 186us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.613058:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00010000:00010000:3.0:1785219888.615483:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.615501:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.615531:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.615544:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.615554:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219888.621814:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1785219888.621845:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.621858:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.621866:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.621872:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219888.621877:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.621885:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.623052:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219888.623059:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219888.623066:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.623076:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d0e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219888.623097:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000993f81a reply state 00000000d311d7bd transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219888.623106:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785219888.624525:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:11348:x1871938444131456:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 15778us (15944us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1785219888.624536:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 140 00010000:00010000:0.0:1785219888.633575:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.633591:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.633599:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.633605:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219888.633610:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.633617:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.633646:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cf356788600) 00010000:00010000:0.0:1785219888.633650:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219888.633654:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.633660:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d0ed lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219888.709879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.710888:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444131712 00000100:00100000:0.0:1785219888.710901:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444131712 00000100:00100000:0.0:1785219888.711192:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:0.0:1785219888.711205:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+14:11356:x1871938444131712:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:0.0:1785219888.711229:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219888.711250:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d0f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f506 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.711313:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078d0fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.711326:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.711339:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219888.711419:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785219888.711423:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219888.711454:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.711489:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d0f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f506 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.711504:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078d0fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f506 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.711512:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:0.0:1785219888.711515:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785219888.711519:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1a00, rc 0) 00000100:00100000:0.0:1785219888.711570:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:11356:x1871938444131712:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 369us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.712758:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 141 00000100:00100000:1.0:1785219888.756869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.756986:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444131840 00000100:00100000:0.0:1785219888.756994:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444131840 00000100:00100000:0.0:1785219888.757055:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:0.0:1785219888.757066:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+15:11362:x1871938444131840:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1785219888.757084:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219888.757106:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d102 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f50d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757176:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757195:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757206:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757233:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757241:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757248:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757437:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078d117 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757446:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078d117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757452:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078d117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219888.757484:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1785219888.757488:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219888.757516:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078d117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757527:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757533:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757539:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757555:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219888.757560:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757572:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757584:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:0.0:1785219888.757587:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219888.757591:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757598:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757611:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757617:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757623:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757628:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219888.757631:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757637:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757654:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cf342843000) 00010000:00010000:0.0:1785219888.757656:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219888.757659:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757664:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d110 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757694:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d102 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f50d expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757706:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078d117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f50d expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.757714:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219888.757716:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1785219888.757717:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0000, rc 0) 00000100:00100000:0.0:1785219888.757773:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:11362:x1871938444131840:12345-192.168.203.31@tcp:101:bash.0 Request processed in 704us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.757781:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 142 00000100:00100000:1.0:1785219888.763902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.764228:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444132096 00000100:00100000:0.0:1785219888.764238:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444132096 00000100:00100000:1.0:1785219888.764492:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 143 00000100:00100000:1.0:1785219888.764503:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:11362:x1871938444132096:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219888.764522:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219888.764542:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d11e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f514 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.764691:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.764706:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.764717:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.764731:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.764738:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.764759:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785219888.765474:0:8055:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1785219888.765640:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765652:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765661:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765696:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765704:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765711:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765717:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219888.765721:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765728:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765741:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219888.765744:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219888.765756:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.765762:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d125 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785219888.765774:0:8055:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ce86b34 reply state 000000003c224017 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219888.765783:0:8055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785219888.765816:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d11e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 19 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.767886:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 18 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.767903:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:1.0:1785219888.767906:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219888.767909:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29c00, rc 0) 00000100:00100000:1.0:1785219888.768198:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11362:x1871938444132096:12345-192.168.203.31@tcp:101:bash.0 Request processed in 3696us (4303us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1785219888.768207:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 143 00010000:00010000:3.0:1785219888.770618:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.770634:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.770642:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.770648:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219888.770653:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.770661:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.770699:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf34a6a9300) 00010000:00010000:3.0:1785219888.770703:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219888.770707:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.770713:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d12c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219888.774012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.774100:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444132224 00000100:00100000:0.0:1785219888.774114:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444132224 00000100:00100000:0.0:1785219888.774206:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1785219888.774219:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2362:x1871938444132224:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1785219888.774244:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219888.774292:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f51b expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785219888.774324:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219888.774346:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1785219888.774351:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219888.774401:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 6 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.774426:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 6 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.774441:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0c00, rc 0) 00000100:00100000:0.0:1785219888.774502:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444132224:12345-192.168.203.31@tcp:101:bash.0 Request processed in 287us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.774509:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1785219888.778349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219888.778530:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444132352 00000100:00100000:2.0:1785219888.778539:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444132352 00000100:00100000:2.0:1785219888.778594:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1785219888.778604:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:11362:x1871938444132352:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1785219888.778638:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219888.778658:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f522 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.778690:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.778698:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219888.778703:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219888.778707:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.778742:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.778756:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 7 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219888.778772:0:8158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381776300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8158:1871938465110528:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219888.778880:0:8158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219888.784515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.784641:0:8158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381776300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8158:1871938465110528:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785219888.784675:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 7 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.784696:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9e00, rc 0) 00000100:00100000:0.0:1785219888.784746:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:11362:x1871938444132352:12345-192.168.203.31@tcp:101:bash.0 Request processed in 6144us (6407us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.784754:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:3.0:1785219888.785810:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444132480 00000100:00100000:3.0:1785219888.785821:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444132480 00010000:00010000:2.0:1785219888.786130:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 7 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219888.786257:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:2.0:1785219888.786268:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444132480:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219888.786303:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219888.786333:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 7 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.786348:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 7 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.786395:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032b83541/0x8b38d407a078d141 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f51b expref: 7 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.786416:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219888.786420:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219888.786428:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 6 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.786437:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 6 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.786475:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 6 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219888.786489:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381777800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1871938465110656:192.168.203.31@tcp:105: 00000100:00100000:2.0:1785219888.786569:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219888.791638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219888.792408:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444132736 00000100:00100000:3.0:1785219888.792419:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444132736 00000100:00100000:3.0:1785219888.792475:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1785219888.792485:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:11362:x1871938444132736:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1785219888.792876:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11362:x1871938444132736:12345-192.168.203.31@tcp:35:bash.0 Request processed in 391us (1246us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1785219888.792885:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:2.0:1785219888.796015:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381777800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1871938465110656:192.168.203.31@tcp:105: 00010000:00010000:2.0:1785219888.796040:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219888.796134:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444132480:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 9867us (11627us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219888.796144:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1785219888.871284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.871389:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444132992 00000100:00100000:0.0:1785219888.871412:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444132992 00000100:00100000:0.0:1785219888.871467:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:0.0:1785219888.871477:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11372:x1871938444132992:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785219888.871501:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219888.871521:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d14f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f529 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219888.872096:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1785219888.872226:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d14f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f529 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.872241:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:0.0:1785219888.872244:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785219888.872248:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d14f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f529 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.872263:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1e00, rc 0) 00000100:00100000:0.0:1785219888.872328:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11372:x1871938444132992:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 852us (1054us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1785219888.872335:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:1.0:1785219888.875880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.875951:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444133248 00000100:00100000:0.0:1785219888.875960:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444133248 00000100:00100000:0.0:1785219888.876027:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1785219888.876037:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11372:x1871938444133248:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785219888.876284:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:11372:x1871938444133248:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 247us (411us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1785219888.876292:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1785219888.953838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.953957:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444133376 00000100:00100000:0.0:1785219888.953967:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444133376 00000100:00100000:0.0:1785219888.954025:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:0.0:1785219888.954034:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:11378:x1871938444133376:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785219888.954058:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219888.954078:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d15d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f530 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.954138:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.954148:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.954710:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219888.954774:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1785219888.954778:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219888.954887:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.954929:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d15d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f530 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.954948:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f530 expref: 22 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.954959:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219888.954962:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785219888.954981:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0c00, rc 0) 00000100:00100000:0.0:1785219888.955042:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:11378:x1871938444133376:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1009us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.955051:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 145 00000100:00100000:1.0:1785219888.958880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219888.959063:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444133632 00000100:00100000:3.0:1785219888.959072:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444133632 00000100:00100000:3.0:1785219888.959129:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:3.0:1785219888.959139:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:11378:x1871938444133632:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219888.959171:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219888.959194:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d16b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f537 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.959289:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.959322:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.959334:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219888.959542:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1785219888.959757:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d16b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f537 expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.959777:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f537 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219888.959786:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:3.0:1785219888.959789:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219888.959793:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030c00, rc 0) 00000100:00100000:3.0:1785219888.959856:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11378:x1871938444133632:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 719us (987us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1785219888.959864:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 146 00000100:00100000:1.0:1785219888.968467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219888.968501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.968684:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444133888 00000100:00100000:0.0:1785219888.968693:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444133888 00000100:00100000:0.0:1785219888.968754:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1785219888.968764:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:2361:x1871938444133888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219888.968780:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219888.968803:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f537 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.968823:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:0.0:1785219888.968840:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219888.968896:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:2361:x1871938444133888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 133us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.968904:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:2.0:1785219888.974284:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444134016 00000100:00100000:2.0:1785219888.974298:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444134016 00000100:00100000:2.0:1785219888.974473:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:2.0:1785219888.974484:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:11378:x1871938444134016:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219888.974508:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219888.974530:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f53e expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.974628:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078d187 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.974643:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078d187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.974655:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078d187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219888.974668:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1785219888.974785:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f53e expref: 26 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.974805:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078d187 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f53e expref: 25 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219888.974815:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:2.0:1785219888.974818:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785219888.974848:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9000, rc 0) 00000100:00100000:2.0:1785219888.974916:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11378:x1871938444134016:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 434us (6414us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1785219888.974924:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 147 00000100:00100000:1.0:1785219888.985673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.985817:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444134144 00000100:00100000:0.0:1785219888.985837:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444134144 00000100:00100000:0.0:1785219888.985884:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1785219888.985894:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444134144:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:0.0:1785219888.985938:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.985958:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 6 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.985984:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219888.985988:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785219888.985992:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.986026:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 6 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.986042:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 6 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219888.986057:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6586:1871938465110784:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785219888.986141:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf356b59f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219888.989062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219888.989143:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444134272 00000100:00100000:1.0:1785219888.989152:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444134272 00002000:00100000:1.0:1785219888.989205:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cf348a3e680 x1871938444134272/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:504/0 lens 504/0 e 0 to 0 dl 1785219899 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219888.989217:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf348a3e680 with x1871938444134272 ext(0->12) 00010000:00010000:1.0:1785219888.989226:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 7 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.989242:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 7 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785219888.989251:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf348a3e680 00000100:00100000:1.0:1785219888.989282:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785219888.989291:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444134272:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:1.0:1785219888.989803:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444134272:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 512us (747us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1785219888.989811:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00002000:00100000:1.0:1785219888.989819:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cf348a3e680 x1871938444134272/t4294967305(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:504/0 lens 504/448 e 0 to 0 dl 1785219899 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219888.989841:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf348a3e680 with x1871938444134272 ext(0->12) 00010000:00010000:1.0:1785219888.989848:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 9 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.989870:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 9 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785219888.989885:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf348a3e680 00000100:00100000:0.0:1785219888.991226:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6586:1871938465110784:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785219888.991252:0:6586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219888.993236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.993706:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444134400 00000100:00100000:0.0:1785219888.993714:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444134400 00010000:00010000:0.0:1785219888.993750:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 9 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219888.993856:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1785219888.993867:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2360:x1871938444134400:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219888.993897:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1785219888.993927:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1785219888.993931:0:6603:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785219888 00002000:00010000:0.0:1785219888.993933:0:6603:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1785219888 00002000:00010000:0.0:1785219888.993935:0:6603:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1785219888 00010000:00010000:0.0:1785219888.993942:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 9 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.993957:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 9 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.993980:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078d148 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f522 expref: 9 pid: 8158 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.993996:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785219888.994000:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785219888.994005:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.994015:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.994039:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219888.994129:0:6586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994140:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994172:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994181:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994189:0:6586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994196:0:6586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219888.994201:0:6586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994210:0:6586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994223:0:6586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219888.994243:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a9d490f/0x8b38d407a078d195 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219888.994322:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2362:x1871938444134144:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 8429us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219888.994331:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:0.0:1785219888.994518:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2360:x1871938444134400:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 653us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219888.994526:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1785219888.997421:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219888.997593:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444134656 00000100:00100000:0.0:1785219888.997603:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444134656 00000100:00100000:0.0:1785219888.997660:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:0.0:1785219888.997669:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11378:x1871938444134656:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:0.0:1785219888.997729:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078d187 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f53e expref: 25 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785219888.998033:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1785219888.998100:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1785219888.998857:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1785219888.998921:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.998938:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 29 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.998947:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.998980:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 29 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219888.998994:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 29 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219888.999008:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1871938465110912:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785219888.999411:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf356b59f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219889.002848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219889.002924:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444134784 00000100:00100000:2.0:1785219889.002933:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444134784 00010000:00010000:2.0:1785219889.002971:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 30 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219889.003011:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1785219889.003020:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:2361:x1871938444134784:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219889.003035:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219889.003041:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 30 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219889.003284:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 30 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219889.003308:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:2.0:1785219889.003313:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219889.003323:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219889.003330:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219889.003389:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219889.003448:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:2361:x1871938444134784:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 428us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219889.003455:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00010000:00010000:0.0:1785219889.004326:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f514 expref: 29 pid: 8055 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219889.005012:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1871938465110912:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785219889.005036:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.005117:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.005126:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219889.005255:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1785219889.005459:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1785219889.005565:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37f13c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465111040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1785219889.005620:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219889.005657:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219889.005784:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465111040 00000100:00100000:2.0:1785219889.005792:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465111040 00000100:00100000:2.0:1785219889.005865:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785219889.005875:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1871938465111040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1785219889.005960:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1871938465111040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219889.005968:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785219889.006002:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37f13c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465111040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1785219889.006484:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1785219889.006547:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465111168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1785219889.006582:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219889.006610:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf356b59780 going to sleep for 11 seconds 00000100:00100000:2.0:1785219889.006628:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465111168 00000100:00100000:2.0:1785219889.006634:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465111168 00000100:00100000:2.0:1785219889.006656:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785219889.006662:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1871938465111168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1785219889.006805:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1871938465111168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 142us (222us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1785219889.006811:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785219889.007047:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465111168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1785219889.007093:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1785219889.007129:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.007139:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.007147:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.007153:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219889.007158:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.007165:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.007191:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:0.0:1785219889.007194:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1785219889.007199:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.007205:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d19c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785219889.007744:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:3.0:1785219889.007888:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1785219889.008081:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1785219889.008092:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381860727871ns, next at 382860725959ns, rc = 0 00000001:00080000:0.0:1785219889.008100:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1785219889.008144:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9700) 00010000:00010000:0.0:1785219889.008148:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785219889.008156:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078d187 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f53e expref: 33 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219889.008682:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11378:x1871938444134656:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 11012us (11265us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1785219889.008693:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00000020:00080000:0.0:1785219889.008699:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1785219889.011483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219889.011846:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444134912 00000100:00100000:0.0:1785219889.011856:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444134912 00000100:00100000:0.0:1785219889.012023:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1785219889.012033:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11378:x1871938444134912:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785219889.012055:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219889.012078:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d1a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f545 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.012153:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f545 expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.012168:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f545 expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.012185:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219889.012188:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785219889.012191:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0800, rc 0) 00000100:00100000:0.0:1785219889.012255:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11378:x1871938444134912:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 223us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219889.012262:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:1.0:1785219889.015265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219889.015354:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444135168 00000100:00100000:3.0:1785219889.015396:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444135168 00000100:00100000:3.0:1785219889.015443:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1785219889.015452:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11378:x1871938444135168:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1785219889.015672:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:11378:x1871938444135168:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 221us (416us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1785219889.015690:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1785219889.090296:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.090398:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444135424 00000100:00100000:1.0:1785219889.090408:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444135424 00000100:00100000:1.0:1785219889.090502:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:1.0:1785219889.090513:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:11388:x1871938444135424:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219889.090536:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219889.090558:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f54c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219889.090689:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1785219889.090817:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f54c expref: 36 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.090846:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:1.0:1785219889.090849:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219889.090855:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f54c expref: 36 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.090880:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29600, rc 0) 00000100:00100000:1.0:1785219889.090946:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11388:x1871938444135424:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 434us (659us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1785219889.090953:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 149 00000100:00100000:1.0:1785219889.096645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219889.096721:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444135552 00000100:00100000:3.0:1785219889.096731:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444135552 00000100:00100000:3.0:1785219889.096778:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:3.0:1785219889.096789:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11388:x1871938444135552:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1785219889.097006:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097022:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097033:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097049:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097057:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097063:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097160:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097169:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097176:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219889.097231:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097244:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097249:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097255:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097260:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219889.097264:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097271:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097283:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219889.097286:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219889.097290:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097296:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d1b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097311:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097317:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097329:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097334:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219889.097337:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097343:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097351:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf356788900) 00010000:00010000:3.0:1785219889.097353:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219889.097356:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097401:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d1bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097419:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097426:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097432:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097437:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219889.097440:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097456:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097465:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219889.097467:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219889.097471:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.097476:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d1c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219889.097555:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11388:x1871938444135552:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 767us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219889.097564:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 150 00000100:00100000:3.0:1785219889.100739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.100846:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444135808 00000100:00100000:1.0:1785219889.100857:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444135808 00000100:00100000:1.0:1785219889.100926:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:1.0:1785219889.100936:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11388:x1871938444135808:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219889.101218:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:11388:x1871938444135808:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 282us (487us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1785219889.101225:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:2.0:1785219889.153485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.153753:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444136064 00000100:00100000:1.0:1785219889.153768:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444136064 00000100:00100000:1.0:1785219889.153851:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:1.0:1785219889.153861:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:11391:x1871938444136064:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219889.153910:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219889.153936:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f553 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154013:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154028:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154040:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154060:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154067:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154074:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154202:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154211:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154218:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219889.154228:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1785219889.154334:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154342:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154349:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154355:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219889.154359:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154416:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154430:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219889.154433:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219889.154437:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154443:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d1d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154458:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154465:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154471:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154487:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219889.154492:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154498:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154506:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf34a6a9c00) 00010000:00010000:1.0:1785219889.154509:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219889.154512:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154518:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154559:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 39 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154575:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 38 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.154581:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219889.154583:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219889.154585:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29e00, rc 0) 00000100:00100000:1.0:1785219889.154657:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:11391:x1871938444136064:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 797us (1198us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1785219889.154665:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 151 00000100:00100000:3.0:1785219889.164882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.165177:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444136192 00000100:00100000:1.0:1785219889.165211:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444136192 00000100:00100000:1.0:1785219889.165286:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:1.0:1785219889.165296:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:11391:x1871938444136192:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1785219889.165419:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165441:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165455:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165503:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165509:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165521:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165527:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219889.165531:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165538:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165551:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219889.165554:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219889.165559:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.165577:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219889.165674:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:11391:x1871938444136192:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 378us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219889.165682:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:3.0:1785219889.172984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.173172:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444136448 00000100:00100000:1.0:1785219889.173185:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444136448 00000100:00100000:1.0:1785219889.173309:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:1.0:1785219889.173321:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:11391:x1871938444136448:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219889.173717:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:11391:x1871938444136448:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 397us (1905us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1785219889.173725:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:2.0:1785219889.436969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.437123:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444136704 00000100:00100000:1.0:1785219889.437141:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444136704 00000100:00100000:1.0:1785219889.437231:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:1.0:1785219889.437244:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:11422:x1871938444136704:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1785219889.437284:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219889.437312:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f55a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.437537:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.437561:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.437607:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219889.437627:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1785219889.437811:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d1f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f55a expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.437847:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f55a expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.437858:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219889.437862:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219889.437872:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28400, rc 0) 00000100:00100000:1.0:1785219889.437984:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:11422:x1871938444136704:12345-192.168.203.31@tcp:101:cat.0 Request processed in 742us (1036us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1785219889.437992:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:3.0:1785219889.443770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219889.443973:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444136832 00000100:00100000:0.0:1785219889.443987:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444136832 00000100:00100000:0.0:1785219889.444127:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1785219889.444140:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:2359:x1871938444136832:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219889.444162:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219889.444195:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d1fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f55a expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.444217:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219889.444224:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219889.444302:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+40:2359:x1871938444136832:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 165us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219889.444311:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1785219889.446999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219889.447057:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444137088 00000100:00100000:0.0:1785219889.447069:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444137088 00000100:00100000:0.0:1785219889.447140:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1785219889.447159:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+40:11422:x1871938444137088:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:0.0:1785219889.447607:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:11422:x1871938444137088:12345-192.168.203.31@tcp:35:cat.0 Request processed in 456us (620us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1785219889.447616:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00010000:00010000:1.0:1785219889.515878:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219889.526343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.526484:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444137344 00000100:00100000:1.0:1785219889.526498:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444137344 00000100:00100000:1.0:1785219889.526579:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:1.0:1785219889.526591:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:11428:x1871938444137344:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:1.0:1785219889.526626:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219889.526630:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785219889.526668:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f530 expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.526692:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219889.526715:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219889.526735:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d20c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f561 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.526880:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.526899:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 41 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.526919:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.526965:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 41 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.526982:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 41 pid: 8055 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219889.526998:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37f13c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465111296:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219889.527125:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1785219889.529723:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37f13c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465111296:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219889.529762:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219889.532646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219889.532849:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444137472 00000100:00100000:0.0:1785219889.532863:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444137472 00010000:00010000:0.0:1785219889.532937:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 42 pid: 8055 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219889.532994:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:0.0:1785219889.533006:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+42:2361:x1871938444137472:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219889.533027:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219889.533036:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 42 pid: 8055 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.533289:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 42 pid: 8055 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.533333:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d1e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f553 expref: 42 pid: 8055 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.533357:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219889.533486:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.533519:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.533527:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.533564:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219889.533642:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:2361:x1871938444137472:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 638us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219889.533650:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00010000:00010000:1.0:1785219889.533708:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.533716:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219889.533747:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1785219889.533956:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d20c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.533975:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 41 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.533984:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219889.533987:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219889.533989:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28200, rc 0) 00000100:00100000:1.0:1785219889.534017:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:11428:x1871938444137344:12345-192.168.203.31@tcp:101:dd.0 Request processed in 7430us (7699us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1785219889.534025:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 154 00000100:00100000:3.0:1785219889.538060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219889.538192:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444137728 00000100:00100000:0.0:1785219889.538207:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444137728 00000100:00100000:0.0:1785219889.538289:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 155 00000100:00100000:0.0:1785219889.538301:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+41:11428:x1871938444137728:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:0.0:1785219889.538733:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.538755:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.538769:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785219889.538845:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1785219889.538874:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000608e7c28 reply state 00000000be83e63f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219889.538885:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785219889.539010:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+44:11428:x1871938444137728:12345-192.168.203.31@tcp:36:dd.0 Request processed in 709us (973us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1785219889.539043:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 155 00000020:00080000:0.0:1785219889.539050:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785219889.542848:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.542872:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.542881:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.542889:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219889.542896:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.543105:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.543129:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219889.543133:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219889.543140:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219889.543146:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1200/0x8b38d407a078d221 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219889.580033:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219889.580068:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37f13c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465111424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219889.581276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219889.581398:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465111424 00000100:00100000:1.0:1785219889.581411:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465111424 00000100:00100000:1.0:1785219889.581480:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785219889.581492:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465111424:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785219889.581536:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1785219889.581545:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219889.581621:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465111424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219889.581628:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785219889.581693:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37f13c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465111424:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1785219889.706560:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:0.0:1785219889.706593:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1785219889.706898:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37f13c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465111552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785219889.706997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1785219889.707227:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf356b59a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1785219889.707233:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37ef48700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf356b59f00 00000020:00080000:0.0:1785219889.707245:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37ef48200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf37f00f000 00000020:00080000:3.0:1785219889.707480:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1785219889.707721:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1785219889.708750:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465111552 00000100:00100000:1.0:1785219889.708768:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465111552 00000100:00100000:1.0:1785219889.708944:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785219889.708958:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465111552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785219889.709003:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1785219889.709049:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a684b30, atime: 0x6a684b30, ctime: 0x6a684b30, blocks: 0x1 00010000:00010000:1.0:1785219889.709059:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.709083:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1785219889.709089:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219889.709098:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.709121:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.709132:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.709141:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.709179:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785219889.710320:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465111552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1359us (3317us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1785219889.710699:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1785219889.710885:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219889.710898:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.710912:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219889.710924:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.710936:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.710962:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.710976:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000096abc01/0x8b38d407a078d228 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.711006:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219889.711008:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219889.711010:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1785219889.711485:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf37f13c000/2, rc 0, transno 4294967307 00000100:00100000:3.0:1785219889.711505:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37f13c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465111552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785219889.846555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219889.852496:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444137856 00000100:00100000:0.0:1785219889.852520:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444137856 00000100:00100000:1.0:1785219889.852730:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:1.0:1785219889.852743:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+16:11442:x1871938444137856:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:1.0:1785219889.852777:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219889.852807:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d22f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f568 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.853040:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.853060:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.853075:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.853095:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.853103:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.853111:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.854571:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.854598:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.854622:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.854675:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.854696:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 17 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219889.854715:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37f13dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465111680:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219889.858482:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7900 going to sleep for 11 seconds 00000100:00100000:3.0:1785219889.878994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219889.879165:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444138112 00000100:00100000:0.0:1785219889.879186:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444138112 00000100:00100000:0.0:1785219889.879266:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:0.0:1785219889.879286:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:5574:x1871938444138112:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785219889.880559:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:5574:x1871938444138112:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 1271us (1567us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1785219889.880574:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1785219889.885413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219889.886466:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37f13dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465111680:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219889.886506:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219889.889142:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444138240 00000100:00100000:3.0:1785219889.889162:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444138240 00010000:00010000:3.0:1785219889.889238:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 19 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219889.889301:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:3.0:1785219889.889314:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2362:x1871938444138240:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219889.889335:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219889.889343:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 19 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.889419:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 19 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.889449:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d213 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f561 expref: 19 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.889473:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219889.889479:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.889490:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.889500:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219889.889549:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219889.889647:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:2362:x1871938444138240:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 335us (4248us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219889.889656:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00010000:00010000:1.0:1785219889.891300:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891320:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219889.891438:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1785219889.891443:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219889.891474:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891492:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891528:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891535:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891541:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891548:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219889.891552:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891560:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891578:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219889.891582:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219889.891587:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891593:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891611:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891617:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891622:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891634:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219889.891637:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891642:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891651:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf34a6a9a00) 00010000:00010000:1.0:1785219889.891654:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219889.891656:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891662:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d23d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891720:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d22f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f568 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891737:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f568 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219889.891746:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219889.891748:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219889.891750:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28c00, rc 0) 00000100:00100000:1.0:1785219889.891854:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:11442:x1871938444137856:12345-192.168.203.31@tcp:101:stat.0 Request processed in 39113us (45314us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219889.891863:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 156 00000100:00100000:2.0:1785219890.014328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219890.014730:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444138496 00000100:00100000:0.0:1785219890.014745:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444138496 00000100:00100000:0.0:1785219890.014862:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:0.0:1785219890.014875:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:11448:x1871938444138496:12345-192.168.203.31@tcp:36:truncate.0 00010000:00010000:0.0:1785219890.014957:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219890.015103:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f568 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.015128:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219890.015134:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1785219890.015324:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785219890.016261:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.016283:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.016295:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785219890.016421:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1785219890.016449:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005737063a reply state 00000000d7a88e11 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219890.016461:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785219890.016625:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11448:x1871938444138496:12345-192.168.203.31@tcp:36:truncate.0 Request processed in 1748us (2310us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1785219890.016634:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00000020:00080000:0.0:1785219890.016642:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785219890.020508:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.020538:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.020547:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.020575:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219890.020581:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.020590:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.020611:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219890.020614:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219890.020619:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.020626:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078d24b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219890.186193:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219890.186454:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444138624 00000100:00100000:3.0:1785219890.186467:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444138624 00000100:00100000:3.0:1785219890.186554:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:3.0:1785219890.186567:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:11462:x1871938444138624:12345-192.168.203.31@tcp:101:stat.0 00010000:00010000:3.0:1785219890.186600:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219890.186629:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f56f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.186718:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.186736:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.186751:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.186798:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.186807:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.186815:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187485:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187498:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187566:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219890.187617:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1785219890.187624:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219890.187656:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187669:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187678:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187685:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187703:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187710:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219890.187714:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187724:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187738:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219890.187742:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219890.187747:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.187753:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190658:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190679:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190688:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190695:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219890.190700:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190735:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190756:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf356788100) 00010000:00010000:3.0:1785219890.190759:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219890.190765:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190784:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190868:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190886:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.190893:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219890.190896:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219890.190899:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030400, rc 0) 00000100:00100000:3.0:1785219890.190993:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11462:x1871938444138624:12345-192.168.203.31@tcp:101:stat.0 Request processed in 4426us (4817us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219890.191004:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:1.0:1785219890.309971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219890.310184:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444138880 00000100:00100000:2.0:1785219890.310197:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444138880 00000100:00100000:3.0:1785219890.320060:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:3.0:1785219890.320088:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11472:x1871938444138880:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219890.320119:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219890.320152:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d26e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f576 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219890.320803:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1785219890.321517:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d26e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f576 expref: 21 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.321539:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:3.0:1785219890.321543:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785219890.321549:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d26e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f576 expref: 21 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.321566:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030c00, rc 0) 00000100:00100000:3.0:1785219890.321667:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11472:x1871938444138880:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1592us (11708us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1785219890.321677:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 159 00000100:00100000:0.0:1785219890.338892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.339075:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444139136 00000100:00100000:1.0:1785219890.339091:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444139136 00000100:00100000:1.0:1785219890.339183:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:1.0:1785219890.339195:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11472:x1871938444139136:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219890.340112:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:11472:x1871938444139136:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 914us (1229us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1785219890.340124:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1785219890.437194:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219890.442719:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444139392 00000100:00100000:3.0:1785219890.442740:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444139392 00000100:00100000:3.0:1785219890.442913:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:3.0:1785219890.442927:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:11478:x1871938444139392:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219890.442963:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219890.442994:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d27c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f57d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.443883:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.443907:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.443945:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.444001:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.444020:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 22 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219890.444037:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381eda300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465111808:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219890.445031:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf346f1c600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219890.453343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.453556:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444139520 00000100:00100000:1.0:1785219890.453570:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444139520 00010000:00010000:1.0:1785219890.453629:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 23 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219890.453688:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1785219890.453701:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:2362:x1871938444139520:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219890.453723:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219890.453731:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 23 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.453746:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 23 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.453788:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219890.453794:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.453805:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.453846:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.453870:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219890.453944:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:2362:x1871938444139520:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 245us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219890.453953:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00010000:00010000:3.0:1785219890.454283:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f56f expref: 22 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219890.454306:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381eda300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465111808:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219890.454337:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.454347:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.454353:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219890.454431:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1785219890.454644:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d27c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.454680:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.454689:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:3.0:1785219890.454692:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785219890.454695:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:3.0:1785219890.454733:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:11478:x1871938444139392:12345-192.168.203.31@tcp:101:bash.0 Request processed in 11810us (17554us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1785219890.454741:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 160 00000100:00100000:0.0:1785219890.459077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.459194:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444139776 00000100:00100000:1.0:1785219890.459219:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444139776 00000100:00100000:1.0:1785219890.459295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 161 00000100:00100000:1.0:1785219890.459308:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:11478:x1871938444139776:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1785219890.459724:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.459748:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.459765:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219890.459841:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1785219890.459869:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061397833 reply state 00000000abc45724 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219890.459881:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785219890.460003:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37eb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11478:x1871938444139776:12345-192.168.203.31@tcp:36:bash.0 Request processed in 696us (940us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1785219890.460011:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 161 00000020:00080000:1.0:1785219890.460017:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785219890.463002:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.463024:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.463032:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.463039:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219890.463046:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.463055:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.463079:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219890.463082:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219890.463111:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.463118:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d291 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219890.471794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.471934:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444139904 00000100:00100000:1.0:1785219890.471948:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444139904 00000100:00100000:1.0:1785219890.472039:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:1.0:1785219890.472063:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11478:x1871938444139904:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219890.472097:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219890.472125:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d298 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f584 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.472253:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.472271:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.472282:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.472323:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.472712:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 25 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219890.472730:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37f13ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465111936:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219890.472849:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219890.478526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219890.478628:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444140032 00000100:00100000:0.0:1785219890.478641:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444140032 00010000:00010000:0.0:1785219890.478699:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 26 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219890.478756:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1785219890.478770:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:2361:x1871938444140032:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219890.478791:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219890.478799:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 26 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.478825:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 26 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.478854:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219890.478861:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.478873:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.478882:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.478916:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219890.478992:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:2361:x1871938444140032:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 225us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219890.479001:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00010000:00010000:1.0:1785219890.481866:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d283 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f57d expref: 25 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219890.481913:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37f13ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465111936:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219890.481981:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.481993:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.482000:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219890.482082:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1785219890.482087:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219890.482112:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.482533:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d298 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f584 expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.482556:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f584 expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.482572:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219890.482575:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219890.482580:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28000, rc 0) 00000100:00100000:1.0:1785219890.482681:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11478:x1871938444139904:12345-192.168.203.31@tcp:101:bash.0 Request processed in 10631us (10900us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219890.482691:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:2.0:1785219890.491024:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.491550:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444140288 00000100:00100000:1.0:1785219890.491564:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444140288 00000100:00100000:2.0:1785219890.491757:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:2.0:1785219890.491771:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11478:x1871938444140288:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1785219890.492680:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11478:x1871938444140288:12345-192.168.203.31@tcp:35:bash.0 Request processed in 906us (1718us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1785219890.492693:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00010000:00010000:0.0:1785219890.539672:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219890.610205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.615411:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444140544 00000100:00100000:1.0:1785219890.615432:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444140544 00000100:00100000:1.0:1785219890.615620:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:1.0:1785219890.615633:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11488:x1871938444140544:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219890.615677:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219890.615708:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f58b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219890.616077:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1785219890.617400:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f58b expref: 27 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.617424:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:1.0:1785219890.617428:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219890.617434:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f58b expref: 27 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.617451:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28e00, rc 0) 00000100:00100000:1.0:1785219890.617548:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11488:x1871938444140544:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1918us (7358us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1785219890.617557:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 163 00000100:00100000:0.0:1785219890.625568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219890.625804:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444140672 00000100:00100000:3.0:1785219890.625827:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444140672 00000100:00100000:3.0:1785219890.625973:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:3.0:1785219890.625987:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11488:x1871938444140672:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1785219890.626537:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.626564:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219890.626582:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.630442:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.630472:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.630488:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631521:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631536:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631547:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785219890.631611:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631628:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631636:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631654:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631660:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219890.631665:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.631686:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632826:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219890.632836:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219890.632844:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632855:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d2b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632878:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632885:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632892:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632899:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219890.632902:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632928:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632940:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf342843400) 00010000:00010000:0.0:1785219890.632942:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219890.632946:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632952:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d2bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632974:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632981:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632988:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.632994:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219890.632997:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.633003:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.633010:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219890.633012:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219890.633015:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.633033:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d2c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219890.633336:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11488:x1871938444140672:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 7346us (7778us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219890.633348:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 164 00000100:00100000:2.0:1785219890.638956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.643145:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444140928 00000100:00100000:1.0:1785219890.643169:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444140928 00000100:00100000:0.0:1785219890.643560:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1785219890.643574:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11488:x1871938444140928:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785219890.644566:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:11488:x1871938444140928:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 989us (5619us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1785219890.644577:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:2.0:1785219890.682985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219890.684934:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444141184 00000100:00100000:3.0:1785219890.685094:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444141184 00000100:00100000:2.0:1785219890.685403:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1785219890.685418:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:11491:x1871938444141184:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219890.685465:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219890.685495:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9600/0x8b38d407a078d2c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f592 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.685595:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.685613:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.685646:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.685664:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.685672:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.685679:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686190:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078d2de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686202:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078d2de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686210:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078d2de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219890.686223:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1785219890.686384:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686393:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686401:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686407:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219890.686418:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686426:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686441:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219890.686445:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219890.686450:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686457:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d2d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686470:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686477:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686487:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686494:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219890.686497:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686503:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686509:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf345fcda00) 00010000:00010000:2.0:1785219890.686511:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219890.686521:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686528:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d2d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686581:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9600/0x8b38d407a078d2c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f592 expref: 30 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686599:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078d2de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f592 expref: 29 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219890.686607:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:2.0:1785219890.686610:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219890.686612:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8a00, rc 0) 00000100:00100000:2.0:1785219890.686876:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:11491:x1871938444141184:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1460us (3905us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1785219890.686885:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 165 00000100:00100000:2.0:1785219890.693122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.693321:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444141312 00000100:00100000:1.0:1785219890.693335:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444141312 00000100:00100000:1.0:1785219890.693509:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:1.0:1785219890.693521:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:11491:x1871938444141312:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1785219890.693620:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693665:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693681:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693719:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693727:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693735:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693743:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219890.693748:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693757:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693770:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219890.693773:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219890.693779:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.693785:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219890.693895:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:11491:x1871938444141312:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 375us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219890.695544:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 166 00000100:00100000:2.0:1785219890.697712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219890.698624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.698709:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444141696 00000100:00100000:1.0:1785219890.698721:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444141696 00000100:00100000:1.0:1785219890.698809:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:1.0:1785219890.698831:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:2361:x1871938444141696:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219890.698853:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219890.698888:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078d2de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f592 expref: 29 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.698920:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219890.698926:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219890.698991:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:2361:x1871938444141696:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 163us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219890.698998:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:0.0:1785219890.699063:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444141568 00000100:00100000:0.0:1785219890.699070:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444141568 00000100:00100000:0.0:1785219890.699151:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:0.0:1785219890.699161:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:11491:x1871938444141568:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785219890.699450:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:11491:x1871938444141568:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 290us (1748us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1785219890.699458:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1785219890.894465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.894962:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444141952 00000100:00100000:1.0:1785219890.894975:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444141952 00000100:00100000:1.0:1785219890.895058:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:1.0:1785219890.895069:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:11509:x1871938444141952:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:1.0:1785219890.895168:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219890.895199:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f599 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.895343:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078d2fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.895408:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078d2fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.895436:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078d2fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219890.895451:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1785219890.896032:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d2f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f599 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.896056:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078d2fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f599 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.896067:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:1.0:1785219890.896070:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785219890.896074:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29200, rc 0) 00000100:00100000:1.0:1785219890.896323:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11509:x1871938444141952:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1254us (1871us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1785219890.896333:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 167 00000100:00100000:2.0:1785219890.951650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219890.952008:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444142080 00000100:00100000:0.0:1785219890.952021:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444142080 00000100:00100000:0.0:1785219890.952104:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:0.0:1785219890.952115:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11510:x1871938444142080:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785219890.952158:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219890.952185:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5a0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.952303:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d30f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.952321:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d30f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.952333:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d30f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219890.952640:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1785219890.952646:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219890.952738:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d30f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.952786:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a0 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.952809:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d30f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a0 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.952828:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219890.952832:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785219890.952837:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1000, rc 0) 00000100:00100000:0.0:1785219890.952923:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11510:x1871938444142080:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 810us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219890.952931:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 168 00000100:00100000:2.0:1785219890.960778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.960984:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444142464 00000100:00100000:1.0:1785219890.960997:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444142464 00000100:00100000:1.0:1785219890.961088:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:1.0:1785219890.961102:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11510:x1871938444142464:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219890.961609:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11510:x1871938444142464:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 508us (844us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1785219890.961618:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:2.0:1785219890.967601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219890.972400:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444142592 00000100:00100000:0.0:1785219890.972421:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444142592 00000100:00100000:0.0:1785219890.972556:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1785219890.972569:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11510:x1871938444142592:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:0.0:1785219890.972590:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1785219890.972625:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28000/0x8b38d407a078d29f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f584 expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.972654:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29200/0x8b38d407a078d2fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f599 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.972667:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d1a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f545 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219890.972679:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf342843f00) 00010000:00010000:0.0:1785219890.972695:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219890.972976:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:11510:x1871938444142592:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 409us (5388us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219890.972985:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1785219890.988473:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219890.988610:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444142720 00000100:00100000:1.0:1785219890.988623:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444142720 00000100:00100000:1.0:1785219890.988699:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:1.0:1785219890.988711:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:11510:x1871938444142720:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:1.0:1785219890.988903:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.988925:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219890.988939:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785219890.989400:0:8055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1785219890.989528:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:11510:x1871938444142720:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 815us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219890.989539:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 169 00000100:00100000:2.0:1785219891.024510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.024638:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444142848 00000100:00100000:0.0:1785219891.024653:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444142848 00000100:00100000:0.0:1785219891.024732:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 170 00000100:00100000:0.0:1785219891.024744:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:11512:x1871938444142848:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785219891.024783:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219891.024820:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d31d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.024955:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.024984:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.024997:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.025015:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.025023:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.025029:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026104:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026124:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026135:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219891.026257:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1785219891.026262:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219891.026287:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026302:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026325:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026331:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026337:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026343:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219891.026348:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026355:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026398:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219891.026402:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219891.026408:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026415:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d324 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026430:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026436:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026442:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026455:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219891.026459:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026465:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026474:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf342843f00) 00010000:00010000:0.0:1785219891.026477:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219891.026479:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026486:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d32b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026533:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d31d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026549:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.026558:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9a00) 00010000:00010000:0.0:1785219891.026560:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785219891.026563:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0400, rc 0) 00000100:00100000:0.0:1785219891.026648:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11512:x1871938444142848:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1904us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219891.026658:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 170 00010000:00010000:0.0:1785219891.564557:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785219891.701244:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785219891.701259:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785219891.701305:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1785219891.701331:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785219891.701531:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381eda300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465112064:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785219891.701664:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf346f1c000 going to sleep for 11 seconds 00000100:00100000:2.0:1785219891.717231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219891.717237:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381eda300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465112064:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785219891.717346:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444142976 00000100:00100000:1.0:1785219891.717356:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444142976 00000100:00100000:1.0:1785219891.717577:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:1.0:1785219891.717589:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11524:x1871938444142976:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785219891.717942:0:8055:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785219891.718099:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11524:x1871938444142976:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 510us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219891.718109:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 171 00000100:00100000:1.0:1785219891.755690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.755776:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444143104 00000100:00100000:0.0:1785219891.755789:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444143104 00000100:00100000:0.0:1785219891.755877:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:0.0:1785219891.755890:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11524:x1871938444143104:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1785219891.756000:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.756021:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.756037:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758552:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758702:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758718:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758760:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758770:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758777:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219891.758835:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1785219891.758856:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219891.758871:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758885:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758891:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758898:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758903:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219891.758907:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758914:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758927:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:0.0:1785219891.758930:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219891.758934:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758940:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d339 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758955:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758961:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758975:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758980:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219891.758982:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758988:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.758996:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9cf342843f00) 00010000:00010000:0.0:1785219891.758998:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219891.759001:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759007:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d340 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759024:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759030:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759036:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759040:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219891.759043:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759074:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759083:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9a00) 00010000:00010000:0.0:1785219891.759085:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219891.759089:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.759094:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219891.759200:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11524:x1871938444143104:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 3308us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219891.759211:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 172 00000100:00100000:3.0:1785219891.775426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.775518:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444143360 00000100:00100000:0.0:1785219891.775537:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444143360 00000100:00100000:0.0:1785219891.775757:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:0.0:1785219891.775769:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11524:x1871938444143360:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785219891.775790:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219891.775822:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d34e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.775921:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.775936:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.775948:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219891.775974:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1785219891.776147:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776156:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776163:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776169:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219891.776173:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776181:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776192:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9a00) 00010000:00010000:0.0:1785219891.776194:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785219891.776198:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776204:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776243:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d34e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ae expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776255:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:0.0:1785219891.776257:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785219891.776268:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078d34e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ae expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.776278:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1800, rc 0) 00000100:00100000:0.0:1785219891.776350:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11524:x1871938444143360:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 583us (994us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1785219891.776357:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 173 00000100:00100000:2.0:1785219891.786461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.786643:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444143488 00000100:00100000:0.0:1785219891.786657:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444143488 00000100:00100000:0.0:1785219891.786739:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:0.0:1785219891.786750:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11524:x1871938444143488:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785219891.786831:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785219891.787637:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11524:x1871938444143488:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 882us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219891.787650:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 174 00000100:00100000:1.0:1785219891.802183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219891.802346:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444143744 00000100:00100000:3.0:1785219891.802357:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444143744 00000100:00100000:3.0:1785219891.802525:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:3.0:1785219891.802535:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37f13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11524:x1871938444143744:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219891.802555:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219891.802558:0:8055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785219891.802783:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1000/0x8b38d407a078d30f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a0 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.802805:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219891.802820:0:8055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219891.802834:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d363 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5b5 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785219891.803885:0:8055:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1785219891.804186:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d36a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.804202:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d36a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.804214:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d36a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.804292:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d363 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5b5 expref: 34 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.804311:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d36a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5b5 expref: 33 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.804320:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788100) 00010000:00010000:3.0:1785219891.804323:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219891.804326:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030400, rc 0) 00000100:00100000:3.0:1785219891.804425:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37f13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11524:x1871938444143744:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1890us (2252us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1785219891.804433:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 175 00000100:00100000:2.0:1785219891.838055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219891.838143:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444144000 00000100:00100000:1.0:1785219891.838158:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444144000 00000100:00100000:1.0:1785219891.838241:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:1.0:1785219891.838253:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11524:x1871938444144000:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785219891.838330:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219891.838405:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d36a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5b5 expref: 33 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838433:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788100) 00010000:00010000:1.0:1785219891.838448:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219891.838478:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838496:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838507:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838527:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838533:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838540:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838890:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838900:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838908:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838915:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219891.838925:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838933:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838943:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219891.838946:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219891.838951:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838958:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d378 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838968:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838974:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838979:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838984:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219891.838987:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.838993:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.839000:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb9066452 (ffff9cf34a6a9900) 00010000:00010000:1.0:1785219891.839003:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219891.839013:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.839019:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d37f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9066452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219891.839131:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11524:x1871938444144000:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 879us (1089us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785219891.839140:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 176 00000100:00100000:0.0:1785219891.845777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219891.845938:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444144128 00000100:00100000:3.0:1785219891.845950:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444144128 00000100:00100000:3.0:1785219891.846030:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:3.0:1785219891.846041:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11524:x1871938444144128:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219891.846073:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219891.846103:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d386 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5bc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.846150:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.846167:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.846181:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.846331:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.846354:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.846519:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219891.846523:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785219891.846528:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030c00, rc 0) 00000100:00100000:3.0:1785219891.846644:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11524:x1871938444144128:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 604us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219891.846652:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 177 00000100:00100000:3.0:1785219891.851563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219891.853845:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444144384 00000100:00100000:1.0:1785219891.853867:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444144384 00000100:00100000:1.0:1785219891.853957:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 178 00000100:00100000:1.0:1785219891.853971:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+33:11524:x1871938444144384:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785219891.854749:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.854772:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219891.854787:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785219891.855422:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1785219891.855436:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384708071797ns, next at 385708069532ns, rc = 0 00000004:00010000:1.0:1785219891.855557:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000794d0ad7 reply state 00000000afc5e73f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219891.855569:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785219891.855724:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11524:x1871938444144384:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 1752us (4173us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1785219891.855749:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 178 00010000:00010000:3.0:1785219891.858395:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.858415:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.858424:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.858431:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219891.858437:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.858446:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.858487:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219891.858491:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785219891.858496:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.858502:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219891.873238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219891.879607:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444144512 00000100:00100000:3.0:1785219891.879629:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444144512 00000100:00100000:3.0:1785219891.886973:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:3.0:1785219891.886995:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:11524:x1871938444144512:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219891.887028:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219891.887061:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5c3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.887148:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 35 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.887166:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 35 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.887201:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785219891.887206:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219891.887210:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030200, rc 0) 00000100:00100000:3.0:1785219891.887310:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11524:x1871938444144512:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 323us (14084us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219891.887330:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 179 00000100:00100000:3.0:1785219891.896405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219891.896503:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444144640 00000100:00100000:1.0:1785219891.896517:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444144640 00000100:00100000:1.0:1785219891.896620:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:1.0:1785219891.896684:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444144640:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1785219891.897170:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444144640:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 489us (814us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1785219891.897179:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00080000:3.0:1785219891.897798:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219891.907491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219891.908725:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444144896 00000100:00100000:1.0:1785219891.908744:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444144896 00000100:00100000:1.0:1785219891.908843:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:1.0:1785219891.908856:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11524:x1871938444144896:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785219891.909199:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:11524:x1871938444144896:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 345us (1723us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1785219891.909208:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:3.0:1785219891.913064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219891.913120:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444145152 00000100:00100000:3.0:1785219891.913133:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444145152 00000100:00100000:3.0:1785219891.913210:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:3.0:1785219891.913223:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:11524:x1871938444145152:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1785219891.913393:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:11524:x1871938444145152:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 172us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219891.913401:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 180 00000100:00100000:3.0:1785219891.919066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.919187:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444145280 00000100:00100000:0.0:1785219891.919200:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444145280 00000100:00100000:0.0:1785219891.919289:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:0.0:1785219891.919301:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:11524:x1871938444145280:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785219891.919333:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219891.919391:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d3a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5ca expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.919488:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.919507:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.919535:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219891.919602:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219891.919627:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.919661:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d3a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ca expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.919682:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ca expref: 37 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.919694:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:0.0:1785219891.919698:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785219891.919702:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0600, rc 0) 00000100:00100000:0.0:1785219891.919776:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:11524:x1871938444145280:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 476us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219891.919784:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 181 00000100:00100000:3.0:1785219891.924128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.924304:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444145408 00000100:00100000:0.0:1785219891.924319:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444145408 00000100:00100000:0.0:1785219891.924432:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1785219891.924444:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444145408:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785219891.924470:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219891.924501:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5d1 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785219891.924566:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a684b33, blocks: 0x1 00010000:00010000:0.0:1785219891.924593:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1785219891.924598:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219891.924610:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.924632:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.924648:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1800, rc 0) 00000100:00100000:0.0:1785219891.925082:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444145408:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 637us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219891.925093:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1785219891.934010:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.934167:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444145664 00000100:00100000:0.0:1785219891.934279:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444145664 00000100:00100000:0.0:1785219891.934419:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:0.0:1785219891.934433:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:11524:x1871938444145664:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785219891.934591:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:11524:x1871938444145664:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 160us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219891.934599:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 182 00000100:00100000:3.0:1785219891.944816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219891.945928:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444145792 00000100:00100000:0.0:1785219891.945948:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444145792 00000100:00100000:0.0:1785219891.954359:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:0.0:1785219891.954398:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:11524:x1871938444145792:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785219891.954435:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219891.954462:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5d8 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.954503:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 9 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.954514:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219891.954520:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219891.954527:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 9 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.954573:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 9 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.954590:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 9 pid: 6588 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219891.954607:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381170380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465112192:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785219891.954745:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf356b59540 going to sleep for 11 seconds 00000100:00100000:0.0:1785219891.958045:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381170380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465112192:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785219891.958096:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 9 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219891.958125:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0800, rc 0) 00000100:00100000:0.0:1785219891.958224:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:11524:x1871938444145792:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 3836us (13430us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219891.958235:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:0.0:1785219891.961349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219891.961600:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444145920 00000100:00100000:3.0:1785219891.961614:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444145920 00010000:00010000:3.0:1785219891.961667:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 9 pid: 6588 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219891.961719:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1785219891.961730:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444145920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219891.961749:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219891.961780:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 9 pid: 6588 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.961822:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 9 pid: 6588 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.961854:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d3b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d1 expref: 9 pid: 6588 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.961873:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219891.961878:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219891.962217:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.962232:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219891.962288:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219891.962307:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381ed8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5779:1871938465112320:192.168.203.31@tcp:105: 00000100:00100000:3.0:1785219891.962457:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf346f1cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219891.981859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219891.982018:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381ed8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5779:1871938465112320:192.168.203.31@tcp:105: 00010000:00010000:1.0:1785219891.982063:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219891.982237:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444146048 00000100:00100000:2.0:1785219891.982246:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444146048 00002000:00100000:2.0:1785219891.982319:0:12017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cf381ed9f80 x1871938444146048/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:507/0 lens 504/0 e 0 to 0 dl 1785219902 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785219891.982332:0:12017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381ed9f80 with x1871938444146048 ext(0->8) 00002000:00010000:2.0:1785219891.982339:0:12017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381ed9f80 00000100:00100000:2.0:1785219891.982512:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1785219891.982523:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2362:x1871938444146048:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1785219891.983268:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:2361:x1871938444145920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 21535us (21929us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219891.983280:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:2.0:1785219891.983550:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2362:x1871938444146048:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 1028us (1705us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1785219891.983559:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00002000:00100000:2.0:1785219891.983568:0:12017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cf381ed9f80 x1871938444146048/t4294967314(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:507/0 lens 504/448 e 0 to 0 dl 1785219902 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785219891.983578:0:12017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381ed9f80 with x1871938444146048 ext(0->8) 00002000:00010000:2.0:1785219891.983584:0:12017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381ed9f80 00000100:00100000:2.0:1785219891.987069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219891.987119:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444146176 00000100:00100000:2.0:1785219891.987141:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444146176 00000100:00100000:2.0:1785219891.987210:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:2.0:1785219891.987221:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:11524:x1871938444146176:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000040:00080000:1.0:1785219892.045554:0:12357:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785219892.045566:0:12357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785219892.045630:0:12357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1785219892.045638:0:12357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1785219892.060163:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:3.0:1785219892.060292:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1785219892.060304:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1785219892.060419:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1785219892.060446:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1785219892.060478:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1785219892.060497:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:11524:x1871938444146176:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 73265us (73431us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219892.060511:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 183 00000100:00100000:0.0:1785219892.063278:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219892.063644:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444146304 00000100:00100000:3.0:1785219892.063657:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444146304 00000100:00100000:3.0:1785219892.063725:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:3.0:1785219892.063736:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2360:x1871938444146304:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1785219892.064113:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785219892.064145:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465112448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1785219892.064397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219892.064478:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465112448 00000100:00100000:1.0:1785219892.064485:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465112448 00000100:00100000:1.0:1785219892.064545:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785219892.064553:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465112448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1785219892.064741:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785219892.064746:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785219891 00002000:00010000:1.0:1785219892.064749:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785219892.064751:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1785219891 -> 1785219891 00002000:00010000:1.0:1785219892.064753:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1785219892.064813:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1871938465112448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (438us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1785219892.064823:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1785219892.064849:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1785219892.065049:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf348065180/2, rc 0, transno 4294967315 00000100:00100000:1.0:1785219892.065057:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465112448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1785219892.121121:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2360:x1871938444146304:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 57374us (57845us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219892.121137:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000001:00080000:2.0:1785219892.121429:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1785219892.121442:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1785219892.121450:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1785219892.128965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219892.133249:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444146560 00000100:00100000:1.0:1785219892.133272:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444146560 00000100:00100000:0.0:1785219892.134472:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00080000:1.0:1785219892.134488:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219892.134489:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:11524:x1871938444146560:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785219892.134553:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219892.134582:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ca expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.134599:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:0.0:1785219892.134604:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785219892.134636:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.134651:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.134661:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785219892.134956:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058338371 reply state 00000000f04863ac transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219892.134966:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785219892.135078:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11524:x1871938444146560:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 593us (6127us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1785219892.135085:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 184 00000100:00100000:1.0:1785219892.140932:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465112576:0@lo:400:kworker.0 00000100:00100000:2.0:1785219892.140961:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465112832:0@lo:400:kworker.0 00000100:00100000:0.0:1785219892.141024:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465112704:0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.141527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219892.141582:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465113088:0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.141612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219892.141658:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465112576 00000100:00100000:1.0:1785219892.141666:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465112576 00000100:00100000:1.0:1785219892.141734:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1785219892.141743:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3306:x1871938465112576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.141817:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3306:x1871938465112576:12345-0@lo:400:kworker.0 Request processed in 62us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219892.141825:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1785219892.141858:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465113088 00000100:00100000:1.0:1785219892.141861:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465113088 00000100:00100000:1.0:1785219892.141890:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785219892.141896:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465113088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.141928:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465113088:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219892.141934:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1785219892.141953:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785219892.141985:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:3306:1871938465112576:0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.142011:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465113088:0@lo:400:kworker.0 00000100:00100000:2.0:1785219892.144039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219892.144101:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785219892.144111:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465112832 00000100:00100000:2.0:1785219892.144112:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465112960:0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.144118:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465112832 00000100:00100000:2.0:1785219892.144158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219892.144167:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465112960 00000100:00100000:1.0:1785219892.144170:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465112960 00000100:00100000:1.0:1785219892.144190:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1785219892.144197:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465112832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.144248:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465112832:12345-0@lo:400:kworker.0 Request processed in 51us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219892.144254:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1785219892.144269:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1785219892.144275:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465112960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.144317:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465112960:12345-0@lo:400:kworker.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219892.144323:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1785219892.144340:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219892.144850:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465112960:0@lo:400:kworker.0 00000100:00100000:2.0:1785219892.144862:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465112832:0@lo:400:kworker.0 00000100:00100000:0.0:1785219892.148143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219892.148568:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465112704 00000100:00100000:1.0:1785219892.148577:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465112704 00000100:00100000:1.0:1785219892.148635:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1785219892.148644:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465112704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219892.148898:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465112704:12345-0@lo:400:kworker.0 Request processed in 254us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219892.148906:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1785219892.149067:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465112704:0@lo:400:kworker.0 00000100:00100000:3.0:1785219892.149459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219892.149841:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444146688 00000100:00100000:1.0:1785219892.149848:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444146688 00000100:00100000:1.0:1785219892.149892:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:1.0:1785219892.149901:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444146688:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1785219892.150286:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1785219892.150291:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1785219891 -> 1785219889 00002000:00010000:1.0:1785219892.150294:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785219888 00002000:00010000:1.0:1785219892.150296:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1785219891 -> 1785219889 00002000:00010000:1.0:1785219892.150298:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1785219892.150444:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444146688:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 543us (987us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1785219892.150452:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00010000:00010000:0.0:1785219892.150620:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.150631:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.150638:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.150644:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219892.150649:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.150656:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.150674:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:0.0:1785219892.150676:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219892.150738:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.150745:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3be lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219892.153921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219892.154182:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444146944 00000100:00100000:2.0:1785219892.154193:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444146944 00000100:00100000:2.0:1785219892.154243:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1785219892.154253:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:11524:x1871938444146944:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1785219892.154321:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.154340:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.154349:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.154400:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.154415:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 18 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219892.154439:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f78000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465113216:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219892.154514:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348731840 going to sleep for 11 seconds 00000100:00100000:2.0:1785219892.159696:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f78000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465113216:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219892.159725:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219892.165586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219892.165667:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444147072 00000100:00100000:2.0:1785219892.165677:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444147072 00010000:00010000:2.0:1785219892.165716:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 19 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219892.165749:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1785219892.165758:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2362:x1871938444147072:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219892.165773:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219892.165780:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 19 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.165793:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 19 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.165824:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d38d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5bc expref: 19 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.165838:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:2.0:1785219892.165842:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.165860:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.165867:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.165901:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219892.165956:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+18:2362:x1871938444147072:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 198us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219892.165964:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00010000:00010000:1.0:1785219892.166150:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166166:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166196:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166203:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166209:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166216:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219892.166220:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166227:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166237:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:1.0:1785219892.166239:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1785219892.166243:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.166249:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d3c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219892.166311:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:11524:x1871938444146944:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 12059us (12398us total) trans 0 rc -22/-22 00000100:00100000:1.0:1785219892.166318:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 185 00000100:00100000:2.0:1785219892.178354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219892.178459:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444147200 00000100:00100000:3.0:1785219892.178469:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444147200 00000100:00100000:3.0:1785219892.178528:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1785219892.178538:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2360:x1871938444147200:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1785219892.178583:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.178603:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.178612:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785219892.178617:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219892.178622:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.178657:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.178685:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 8 pid: 6586 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219892.178701:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381ed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1871938465113344:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219892.178785:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf38173fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219892.189732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219892.189768:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444147328 00000100:00100000:2.0:1785219892.189777:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444147328 00010000:00010000:2.0:1785219892.189826:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 9 pid: 6586 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219892.189865:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1785219892.189875:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444147328:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219892.189944:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219892.189966:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 9 pid: 6586 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.189981:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 9 pid: 6586 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.190069:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219892.190081:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219892.190087:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.190096:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.190116:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219892.190224:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444147328:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 350us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219892.190231:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00010000:00010000:3.0:1785219892.190717:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d3b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5d8 expref: 8 pid: 6586 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219892.190733:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381ed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6589:1871938465113344:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219892.190755:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190766:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190773:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190800:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190820:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190840:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190847:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219892.190851:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190859:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190872:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219892.190879:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011394a33/0x8b38d407a078d3cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219892.191074:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2360:x1871938444147200:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 12536us (12727us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219892.191082:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:3.0:1785219892.200263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219892.200646:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444147584 00000100:00100000:0.0:1785219892.200656:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444147584 00000100:00100000:0.0:1785219892.200715:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 186 00000100:00100000:0.0:1785219892.200726:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+17:11524:x1871938444147584:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1785219892.200824:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.200839:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.200851:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.201082:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.201094:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.201103:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.201139:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.201154:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 18 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219892.201168:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465113472:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785219892.201253:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf356b599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219892.211469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219892.211549:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444147712 00000100:00100000:1.0:1785219892.211558:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444147712 00010000:00010000:1.0:1785219892.211597:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 19 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219892.211638:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:1.0:1785219892.211648:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2362:x1871938444147712:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219892.211661:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219892.211668:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 19 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.211681:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 19 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.211703:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:1.0:1785219892.211709:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.211718:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.211725:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.211744:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219892.211801:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2362:x1871938444147712:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 153us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219892.211818:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00010000:00010000:0.0:1785219892.214053:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d39b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5c3 expref: 18 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219892.214077:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465113472:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785219892.214111:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.214121:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219892.214127:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785219892.214323:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1785219892.214511:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1785219892.214560:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1785219892.214651:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465113600:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785219892.214712:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219892.214745:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf356b59cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219892.215035:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465113600 00000100:00100000:3.0:1785219892.215042:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465113600 00000100:00100000:3.0:1785219892.215097:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785219892.215107:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1871938465113600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785219892.215192:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1871938465113600:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219892.215208:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785219892.215388:0:5793:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1785219892.215393:0:5793:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf348065180, transno 4294967315 00000100:00100000:0.0:1785219892.215409:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465113600:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1785219892.215834:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1785219892.217114:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465113728:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785219892.217258:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219892.220351:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf356b599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219892.221085:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465113728 00000100:00100000:1.0:1785219892.221104:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465113728 00000100:00100000:1.0:1785219892.221262:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785219892.221271:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5793:x1871938465113728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785219892.221557:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5793:x1871938465113728:12345-0@lo:1000:mdt00_000.0 Request processed in 286us (4298us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1785219892.221565:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219892.221662:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5793:1871938465113728:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1785219892.221709:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221720:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221727:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221735:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219892.221739:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221746:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221762:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf356788900) 00010000:00010000:2.0:1785219892.221772:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785219892.221778:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221784:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078d3da lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221825:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221833:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221839:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221844:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219892.221847:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221853:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221861:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9a00) 00010000:00010000:2.0:1785219892.221863:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785219892.221866:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221871:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d316 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221903:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221928:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221937:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221973:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.221996:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 21 pid: 5793 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219892.222010:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465113856:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219892.222192:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348731840 going to sleep for 11 seconds 00000100:00100000:2.0:1785219892.231682:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219892.231718:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444147840 00000100:00100000:2.0:1785219892.231726:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444147840 00010000:00010000:2.0:1785219892.231767:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 22 pid: 5793 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219892.231812:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:2.0:1785219892.231821:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:2362:x1871938444147840:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219892.231836:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219892.231844:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 22 pid: 5793 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.231869:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 22 pid: 5793 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.231901:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9a00) 00010000:00010000:2.0:1785219892.231906:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.231915:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.231923:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.231942:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219892.232004:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:2362:x1871938444147840:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 183us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219892.232012:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00010000:00010000:1.0:1785219892.235020:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5a7 expref: 21 pid: 5793 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219892.235045:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465113856:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219892.235348:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235359:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235385:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235400:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235406:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235414:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235421:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219892.235425:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235447:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235463:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9a00) 00010000:00010000:1.0:1785219892.235467:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219892.235471:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235478:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9c00/0x8b38d407a078d3e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235489:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235494:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235499:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235503:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219892.235506:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235510:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235517:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9a00) 00010000:00010000:1.0:1785219892.235518:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785219892.235521:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219892.235534:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d3d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219892.235772:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11524:x1871938444147584:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 35046us (35519us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1785219892.235782:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 186 00000020:00080000:1.0:1785219892.235788:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1785219892.236013:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219892.236017:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219892.237108:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1785219892.237120:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785219892.247545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219892.247592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219892.247658:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444148096 00000100:00100000:3.0:1785219892.247668:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444148096 00000100:00100000:3.0:1785219892.247737:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:3.0:1785219892.247747:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2359:x1871938444148096:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219892.247831:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2359:x1871938444148096:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219892.247839:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00080000:3.0:1785219892.247862:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785219892.248010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219892.248058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219892.248081:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444148480 00000100:00100000:2.0:1785219892.248086:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444148480 00000100:00100000:2.0:1785219892.248113:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1785219892.248142:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11524:x1871938444148480:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1785219892.248793:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1785219892.248913:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1785219892.248957:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.248974:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.248986:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.248994:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249000:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249007:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249030:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785219892.249101:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:11524:x1871938444148480:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 960us (1050us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1785219892.249109:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000020:00080000:2.0:1785219892.249113:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785219892.249166:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219892.249172:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249180:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219892.249190:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249199:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249212:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf345fcd500) 00010000:00010000:2.0:1785219892.249215:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785219892.249219:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249225:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078d3e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219892.249240:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219892.249242:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219892.249244:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219892.249481:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444148224 00000100:00100000:3.0:1785219892.249487:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444148224 00000100:00100000:3.0:1785219892.249587:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00100000:3.0:1785219892.249594:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2359:x1871938444148224:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219892.249631:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2359:x1871938444148224:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 38us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219892.249637:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 144 00000100:00080000:2.0:1785219892.251242:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219892.253403:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444147968 00000100:00100000:0.0:1785219892.253417:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444147968 00000100:00100000:0.0:1785219892.253479:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 292 00000100:00100000:0.0:1785219892.253489:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444147968:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219892.253559:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444147968:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (5967us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219892.253576:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 292 00010000:00010000:0.0:1785219892.588155:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219892.652106:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219892.652131:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf2458da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465113984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219892.652204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219892.652347:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465113984 00000100:00100000:3.0:1785219892.652356:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465113984 00000100:00100000:3.0:1785219892.652426:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785219892.652436:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465113984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219892.652471:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219892.652523:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465113984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219892.652531:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785219892.652754:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf2458da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465113984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785219893.611905:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785219893.766332:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1785219893.766359:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:0.0:1785219894.095920:0:12411:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785219894.095936:0:12411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785219894.095987:0:12411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1785219894.095996:0:12411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785219894.275086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.275206:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444148736 00000100:00100000:1.0:1785219894.275221:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444148736 00000100:00080000:3.0:1785219894.275280:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219894.275328:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:1.0:1785219894.275344:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:11542:x1871938444148736:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219894.275401:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219894.275432:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d3ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5df expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.275805:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078d3f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.275824:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078d3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.275841:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078d3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219894.275857:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1785219894.276111:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d3ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5df expref: 25 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.276135:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078d3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5df expref: 24 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.276154:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219894.276158:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219894.276163:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28800, rc 0) 00000100:00100000:1.0:1785219894.276258:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11542:x1871938444148736:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 918us (1187us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1785219894.276266:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 187 00000100:00100000:3.0:1785219894.294944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219894.295017:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444148864 00000100:00100000:2.0:1785219894.295033:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444148864 00000100:00100000:2.0:1785219894.295113:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:2.0:1785219894.295126:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11542:x1871938444148864:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1785219894.295338:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295408:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295425:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295447:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295455:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295462:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295972:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295984:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.295992:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219894.296046:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296061:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296068:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296090:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296097:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219894.296102:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296111:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296126:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219894.296130:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219894.296135:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296142:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296157:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296162:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296168:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296174:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219894.296176:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296192:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296519:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf345fcd500) 00010000:00010000:2.0:1785219894.296521:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219894.296525:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296532:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d40b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296551:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296558:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296632:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296638:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219894.296641:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296647:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296656:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf345fcd300) 00010000:00010000:2.0:1785219894.296659:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219894.296661:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.296676:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9800/0x8b38d407a078d412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219894.296851:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11542:x1871938444148864:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1724us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219894.296863:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 188 00000100:00100000:3.0:1785219894.376269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.378891:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444149120 00000100:00100000:1.0:1785219894.378913:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444149120 00000100:00100000:1.0:1785219894.379022:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:1.0:1785219894.379036:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11545:x1871938444149120:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219894.379066:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219894.379095:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5e6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.379201:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.379221:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.379235:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.379253:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.379261:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.379293:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384153:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384179:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384194:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219894.384209:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1785219894.384342:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384352:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384359:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384834:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219894.384840:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384851:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384868:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219894.384872:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219894.384888:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384894:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384911:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384917:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.384922:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.385042:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219894.385046:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.385052:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.386112:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf34a6a9a00) 00010000:00010000:1.0:1785219894.386121:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219894.386127:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.386135:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.386219:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.386251:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.386260:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:1.0:1785219894.386262:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219894.386265:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29c00, rc 0) 00000100:00100000:1.0:1785219894.387513:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11545:x1871938444149120:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 8471us (11266us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1785219894.387526:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 189 00000100:00100000:3.0:1785219894.394038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.394466:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444149248 00000100:00100000:1.0:1785219894.394480:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444149248 00000100:00100000:1.0:1785219894.394548:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:1.0:1785219894.394560:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11545:x1871938444149248:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1785219894.394658:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394681:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394697:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394735:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394742:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394785:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394807:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219894.394813:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394823:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394839:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:1.0:1785219894.394843:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219894.394849:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.394857:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d43c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219894.394950:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11545:x1871938444149248:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 392us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219894.394959:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 190 00000100:00100000:2.0:1785219894.400510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.400616:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444149504 00000100:00100000:1.0:1785219894.400630:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444149504 00000100:00100000:2.0:1785219894.400728:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1785219894.400741:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+26:11545:x1871938444149504:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:2.0:1785219894.401081:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:11545:x1871938444149504:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 342us (584us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1785219894.401090:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:2.0:1785219894.467063:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219894.467157:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444149760 00000100:00100000:3.0:1785219894.467172:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444149760 00000100:00100000:3.0:1785219894.467287:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:3.0:1785219894.467299:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:11070:x1871938444149760:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219894.467336:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219894.467397:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d443 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5ed expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.467553:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.467572:0:8055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.467582:0:8055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.467784:0:8055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.467811:0:8055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 28 pid: 5793 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219894.467828:0:8055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348065180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465114112:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219894.467940:0:8055:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf354f9ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219894.472654:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219894.472865:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444149888 00000100:00100000:3.0:1785219894.472879:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444149888 00010000:00010000:3.0:1785219894.472937:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 29 pid: 5793 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219894.472989:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:3.0:1785219894.473000:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:2362:x1871938444149888:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219894.473019:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219894.473029:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 29 pid: 5793 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.473044:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 29 pid: 5793 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.473071:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:3.0:1785219894.473078:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.473088:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.473098:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.473121:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219894.473189:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:2362:x1871938444149888:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 190us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219894.473198:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00010000:00010000:1.0:1785219894.477112:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d42e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5e6 expref: 28 pid: 5793 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219894.477144:0:8055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348065180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465114112:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219894.477175:0:8055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.477281:0:8055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.477289:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219894.477318:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1785219894.477832:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d443 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 29 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.477858:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 28 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.477869:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:1.0:1785219894.477872:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219894.477876:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:1.0:1785219894.478006:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:11070:x1871938444149760:12345-192.168.203.31@tcp:101:bash.0 Request processed in 10708us (10954us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1785219894.478017:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 191 00000100:00100000:2.0:1785219894.490112:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.490975:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444150144 00000100:00100000:1.0:1785219894.490993:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444150144 00000100:00100000:2.0:1785219894.491221:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 192 00000100:00100000:2.0:1785219894.491236:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:11070:x1871938444150144:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:2.0:1785219894.491849:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.491875:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.491891:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785219894.491968:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1785219894.492019:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f4f51fb reply state 000000002aeaaa18 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219894.492030:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1785219894.492089:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1785219894.492318:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11070:x1871938444150144:12345-192.168.203.31@tcp:36:bash.0 Request processed in 1081us (2216us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1785219894.492328:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 192 00000020:00080000:2.0:1785219894.492335:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1785219894.496548:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.496592:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.496602:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.496611:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219894.496617:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.496626:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.496650:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:3.0:1785219894.496653:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219894.496660:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.496667:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d458 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219894.498842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.498974:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444150272 00000100:00100000:1.0:1785219894.498988:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444150272 00000100:00100000:1.0:1785219894.499059:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:1.0:1785219894.499071:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:11070:x1871938444150272:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219894.499102:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219894.499405:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d45f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5f4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.499512:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d45f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5f4 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.499531:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d45f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5f4 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.499558:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:1.0:1785219894.499562:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785219894.499567:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29c00, rc 0) 00000100:00100000:1.0:1785219894.499652:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11070:x1871938444150272:12345-192.168.203.31@tcp:101:bash.0 Request processed in 583us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219894.499661:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 193 00000100:00100000:0.0:1785219894.503259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219894.503406:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444150400 00000100:00100000:2.0:1785219894.503420:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444150400 00000100:00100000:2.0:1785219894.503518:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1785219894.503529:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:11070:x1871938444150400:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1785219894.503554:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219894.503583:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f5fb expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1785219894.503600:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1785219894.503817:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a684b31, atime: 0x6a684b30, ctime: 0x6a684b31, blocks: 0xb 00010000:00010000:2.0:1785219894.503851:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1785219894.503857:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219894.503867:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.503891:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.503969:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9000, rc 0) 00000100:00100000:2.0:1785219894.504112:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:11070:x1871938444150400:12345-192.168.203.31@tcp:101:bash.0 Request processed in 584us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219894.504121:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:0.0:1785219894.508053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.511547:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444150528 00000100:00100000:1.0:1785219894.511571:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444150528 00002000:00010000:1.0:1785219894.511639:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1785219894.511645:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf2458d8000 with x1871938444150528 ext(0->18446744073709551615) 00002000:00010000:1.0:1785219894.511660:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf2458d8000. 00000100:00100000:1.0:1785219894.511724:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1785219894.511736:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444150528:12345-192.168.203.31@tcp:10:bash.0 00002000:00010000:1.0:1785219894.512120:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1785219894.512125:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1785219889 -> 1785219893 00002000:00010000:1.0:1785219894.512127:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1785219888 -> 1785219888 00002000:00010000:1.0:1785219894.512130:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1785219889 -> 1785219893 00002000:00010000:1.0:1785219894.512132:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1785219894.512220:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444150528:12345-192.168.203.31@tcp:10:bash.0 Request processed in 484us (4181us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1785219894.512248:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00002000:00010000:1.0:1785219894.512253:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1785219894.512257:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf2458d8000 with x1871938444150528 ext(0->18446744073709551615) 00002000:00010000:1.0:1785219894.512263:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf2458d8000. 00000100:00100000:3.0:1785219894.614911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219894.616988:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444150656 00000100:00100000:2.0:1785219894.617010:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444150656 00000100:00100000:2.0:1785219894.617119:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 194 00000100:00100000:2.0:1785219894.617132:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11558:x1871938444150656:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:2.0:1785219894.617664:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.617688:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.617704:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.617722:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.617730:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.617737:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618139:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618150:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618158:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219894.618294:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618308:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618316:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618323:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618330:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219894.618335:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618342:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618357:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219894.618360:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219894.618400:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618407:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d46d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618422:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618428:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618442:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618448:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219894.618451:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618458:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618467:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf345fcd200) 00010000:00010000:2.0:1785219894.618470:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219894.618473:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618478:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618494:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618501:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618507:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618512:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219894.618515:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618533:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618541:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:2.0:1785219894.618543:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219894.618546:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.618552:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d47b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219894.618692:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11558:x1871938444150656:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1559us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219894.618704:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 194 00010000:00010000:2.0:1785219894.635960:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219894.679728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.679847:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444150912 00000100:00100000:1.0:1785219894.679859:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444150912 00000100:00100000:1.0:1785219894.679995:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:1.0:1785219894.680008:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11562:x1871938444150912:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219894.680037:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219894.680068:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d482 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f602 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.680174:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.680193:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.680207:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.680225:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.680232:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.680240:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.680685:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681351:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681397:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219894.681413:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1785219894.681565:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681573:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681581:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681588:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219894.681593:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681603:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681617:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219894.681620:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219894.681627:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681647:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681662:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681666:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681670:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681673:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219894.681675:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681678:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.681683:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf34a6a9a00) 00010000:00010000:1.0:1785219894.681684:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219894.681686:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.682282:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.682352:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29800/0x8b38d407a078d482 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f602 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.682411:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f602 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.682549:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:1.0:1785219894.682552:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785219894.682555:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28600, rc 0) 00000100:00100000:1.0:1785219894.682659:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:11562:x1871938444150912:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 2652us (2945us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1785219894.682669:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 195 00000100:00100000:0.0:1785219894.695806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219894.696220:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444151040 00000100:00100000:2.0:1785219894.696234:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444151040 00000100:00100000:2.0:1785219894.696351:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:2.0:1785219894.696402:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:11562:x1871938444151040:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1785219894.696501:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.696523:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 34 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.696534:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.696578:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 34 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.696610:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 34 pid: 8055 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219894.696629:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465114240:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219894.696738:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219894.700073:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785219894.700104:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465114368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219894.700309:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219894.701571:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465114368 00000100:00100000:1.0:1785219894.701587:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465114368 00000100:00100000:1.0:1785219894.701688:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785219894.701699:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1871938465114368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219894.701756:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219894.701865:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1871938465114368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219894.702243:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465114368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785219894.702420:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1785219894.702489:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219894.705573:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1871938465114240:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785219894.705615:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219894.708357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219894.708764:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444151296 00000100:00100000:2.0:1785219894.708778:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444151296 00000100:00100000:2.0:1785219894.708866:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1785219894.708877:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:5573:x1871938444151296:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1785219894.709836:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:5573:x1871938444151296:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 952us (1486us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1785219894.709847:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:2.0:1785219894.715508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219894.715617:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444151424 00000100:00100000:0.0:1785219894.715628:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444151424 00010000:00010000:0.0:1785219894.715681:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 36 pid: 8055 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219894.715804:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 74 00000100:00100000:0.0:1785219894.715816:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:2362:x1871938444151424:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219894.715835:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219894.715844:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 36 pid: 8055 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.715884:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 36 pid: 8055 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.716184:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d44a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5ed expref: 36 pid: 8055 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.716209:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:0.0:1785219894.716215:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.716226:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.716236:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.716277:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219894.716439:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:2362:x1871938444151424:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 624us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219894.716447:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 74 00010000:00010000:1.0:1785219894.716545:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716557:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716603:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716612:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716620:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716638:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219894.716644:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716653:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716665:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:1.0:1785219894.716668:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219894.716673:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.716679:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d4a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219894.716732:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:11562:x1871938444151040:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 20370us (20950us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219894.716742:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 196 00000100:00100000:0.0:1785219894.721635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.721727:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444151680 00000100:00100000:1.0:1785219894.721741:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444151680 00000100:00100000:1.0:1785219894.721854:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1785219894.721875:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+34:11562:x1871938444151680:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219894.722452:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11562:x1871938444151680:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 585us (830us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1785219894.722460:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:1.0:1785219894.813356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219894.814172:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444151936 00000100:00100000:3.0:1785219894.814188:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444151936 00000100:00100000:3.0:1785219894.814273:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:3.0:1785219894.814286:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+35:11573:x1871938444151936:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1785219894.814320:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219894.814350:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f609 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.814504:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.814523:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.814537:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.814554:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.814562:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.814569:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815431:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d4c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815447:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815458:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219894.815472:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1785219894.815604:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815614:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815630:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815637:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219894.815643:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815651:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815666:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219894.815669:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219894.815675:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815682:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815696:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815703:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815709:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815713:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219894.815716:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815733:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815742:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf356788500) 00010000:00010000:3.0:1785219894.815745:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219894.815748:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815755:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815822:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f609 expref: 38 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815838:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f609 expref: 37 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.815845:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:3.0:1785219894.815848:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219894.815850:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030200, rc 0) 00000100:00100000:3.0:1785219894.816246:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:11573:x1871938444151936:12345-192.168.203.31@tcp:101:cat.0 Request processed in 1960us (2900us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1785219894.816256:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 197 00000100:00100000:0.0:1785219894.824772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219894.825326:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444152192 00000100:00100000:2.0:1785219894.825341:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444152192 00000100:00100000:2.0:1785219894.825454:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:2.0:1785219894.825466:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:11573:x1871938444152192:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:2.0:1785219894.825846:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:11573:x1871938444152192:12345-192.168.203.31@tcp:35:cat.0 Request processed in 382us (1088us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1785219894.825855:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 54 00000100:00100000:0.0:1785219894.855989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219894.856121:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444152448 00000100:00100000:3.0:1785219894.856134:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444152448 00000100:00100000:3.0:1785219894.856217:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 198 00000100:00100000:3.0:1785219894.856229:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:11574:x1871938444152448:12345-192.168.203.31@tcp:36:rm.0 00010000:00010000:3.0:1785219894.856331:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785219894.856415:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d4c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f609 expref: 38 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856445:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f602 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856460:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d45f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5f4 expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856472:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf34a6a9900) 00010000:00010000:3.0:1785219894.856487:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219894.856514:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856531:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856543:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856559:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856566:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.856575:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.857311:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.857324:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.857333:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785219894.860265:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1785219894.860285:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387712920057ns, next at 388712915049ns, rc = 0 00010000:00010000:3.0:1785219894.860433:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860454:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860467:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860477:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860484:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860490:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860521:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785219894.860553:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860570:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860578:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860585:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219894.860591:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860601:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860616:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:3.0:1785219894.860620:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785219894.860626:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860632:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d4dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860659:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860666:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860672:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.860677:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219894.860686:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.860938:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219894.860946:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.860954:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219894.860965:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.860973:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.860983:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785219894.860986:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785219894.860990:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.860995:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d4e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219894.861015:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219894.861018:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219894.861020:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219894.861246:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.861257:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219894.861259:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219894.861263:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.861269:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d4cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219894.861281:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fb4c2fd reply state 00000000b941e8ba transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219894.861292:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785219894.861657:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+37:11574:x1871938444152448:12345-192.168.203.31@tcp:36:rm.0 Request processed in 5424us (5676us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1785219894.861667:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 198 00010000:00010000:2.0:1785219894.872580:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.872606:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.872615:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.872623:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219894.872630:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.872638:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.872661:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf356788500) 00010000:00010000:2.0:1785219894.872664:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219894.872670:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219894.872677:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d4d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219894.942821:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.943067:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444152704 00000100:00100000:1.0:1785219894.943080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444152704 00000100:00100000:1.0:1785219894.943179:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 199 00000100:00100000:1.0:1785219894.943190:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+36:11580:x1871938444152704:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219894.943222:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219894.943250:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d4eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f610 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.943475:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.943494:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.943508:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.943525:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.943533:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.943540:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785219894.944232:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1785219894.944491:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944503:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944512:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944567:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944575:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944583:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944590:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219894.944596:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944605:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944621:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219894.944624:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219894.944631:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944638:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d4f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785219894.944654:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000142691d3 reply state 000000002ca79d37 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219894.944664:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785219894.944704:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28e00/0x8b38d407a078d4eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 39 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944731:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.944741:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:1.0:1785219894.944744:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219894.944746:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28400, rc 0) 00000100:00100000:1.0:1785219894.944846:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:11580:x1871938444152704:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1657us (2039us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1785219894.944856:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 199 00010000:00010000:3.0:1785219894.947614:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.947641:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.947650:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.947658:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219894.947663:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.947683:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.947704:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf34a6a9a00) 00010000:00010000:3.0:1785219894.947707:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219894.947713:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.947720:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d4f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219894.951088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219894.951335:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444152832 00000100:00100000:3.0:1785219894.951350:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444152832 00000100:00100000:3.0:1785219894.951475:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:3.0:1785219894.951488:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2362:x1871938444152832:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219894.951513:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219894.951543:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f617 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785219894.951580:0:8158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785219894.951607:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1785219894.951613:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219894.951626:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 6 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.951650:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 6 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.951694:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07400, rc 0) 00000100:00100000:3.0:1785219894.951766:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2362:x1871938444152832:12345-192.168.203.31@tcp:101:bash.0 Request processed in 280us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219894.951774:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00080000:2.0:1785219894.952980:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785219894.956560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219894.957014:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444152960 00000100:00100000:1.0:1785219894.957039:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444152960 00000100:00100000:1.0:1785219894.957603:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1785219894.957615:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:11580:x1871938444152960:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219894.957640:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219894.957666:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f61e expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.957709:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 7 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.957721:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219894.957726:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219894.957733:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.957815:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 7 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219894.957832:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 7 pid: 8158 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219894.957851:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6589:1871938465114496:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219894.958412:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4780 going to sleep for 11 seconds 00000100:00100000:3.0:1785219894.961736:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6589:1871938465114496:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219894.961795:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.961827:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28e00, rc 0) 00000100:00100000:3.0:1785219894.961911:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:11580:x1871938444152960:12345-192.168.203.31@tcp:101:bash.0 Request processed in 4297us (5366us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219894.961921:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1785219894.964545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219894.965121:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444153088 00000100:00100000:3.0:1785219894.965136:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444153088 00010000:00010000:3.0:1785219894.965200:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 7 pid: 8158 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219894.965259:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:3.0:1785219894.965271:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444153088:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219894.965291:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219894.965323:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 7 pid: 8158 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.965411:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 7 pid: 8158 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.965445:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ebdc28/0x8b38d407a078d50e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f617 expref: 7 pid: 8158 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.965466:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219894.965471:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219894.965481:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.965495:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219894.965564:0:6603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219894.965582:0:6603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381125500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6603:1871938465114624:192.168.203.31@tcp:105: 00000100:00100000:3.0:1785219894.965682:0:6603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3460f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1785219894.971146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219894.971249:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444153344 00000100:00100000:2.0:1785219894.971261:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444153344 00000100:00100000:2.0:1785219894.971336:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:2.0:1785219894.971348:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+38:11580:x1871938444153344:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:2.0:1785219894.971856:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:11580:x1871938444153344:12345-192.168.203.31@tcp:35:bash.0 Request processed in 508us (720us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1785219894.971897:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 55 00000100:00100000:3.0:1785219894.975243:0:6603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381125500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6603:1871938465114624:192.168.203.31@tcp:105: 00010000:00010000:3.0:1785219894.975279:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219894.975360:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444153088:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 10089us (10829us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219894.975401:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1785219895.154169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.154325:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444153472 00000100:00100000:1.0:1785219895.154337:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444153472 00000100:00100000:1.0:1785219895.154446:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:1.0:1785219895.154460:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+39:11596:x1871938444153472:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219895.154494:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219895.154525:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f625 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.154608:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.154625:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.154640:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219895.154717:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1785219895.154733:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219895.154767:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.154811:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f625 expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.154834:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f625 expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.154845:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219895.154849:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785219895.154853:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29e00, rc 0) 00000100:00100000:1.0:1785219895.154946:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+40:11596:x1871938444153472:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 490us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219895.154954:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 200 00000100:00100000:0.0:1785219895.160886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.161014:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444153728 00000100:00100000:1.0:1785219895.161026:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444153728 00000100:00100000:1.0:1785219895.161105:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:1.0:1785219895.161115:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+40:11596:x1871938444153728:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219895.161143:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219895.161170:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d52a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f62c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.161297:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.161313:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.161347:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219895.161361:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1785219895.161546:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d52a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f62c expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.161566:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f62c expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.161575:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:1.0:1785219895.161578:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219895.161581:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28200, rc 0) 00000100:00100000:1.0:1785219895.161659:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+42:11596:x1871938444153728:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 545us (793us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1785219895.161667:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 201 00000100:00100000:0.0:1785219895.166167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.166261:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444153984 00000100:00100000:1.0:1785219895.166276:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444153984 00000100:00100000:1.0:1785219895.166355:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:1.0:1785219895.166398:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+42:11596:x1871938444153984:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219895.166435:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219895.166465:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d53f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f633 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.166639:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.166670:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.166686:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219895.166704:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1785219895.166902:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d53f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f633 expref: 45 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.166925:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f633 expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.166936:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:1.0:1785219895.166939:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785219895.166944:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28c00, rc 0) 00000100:00100000:1.0:1785219895.167038:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+44:11596:x1871938444153984:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 671us (885us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1785219895.167047:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 202 00000100:00100000:2.0:1785219895.167228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.167406:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444154112 00000100:00100000:3.0:1785219895.167414:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444154112 00000100:00100000:3.0:1785219895.167465:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1785219895.167475:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+44:2361:x1871938444154112:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219895.167488:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219895.167509:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f62c expref: 44 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.167523:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:3.0:1785219895.167527:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219895.167566:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+43:2361:x1871938444154112:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 93us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.167573:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:2.0:1785219895.179997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.180097:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444154240 00000100:00100000:1.0:1785219895.180109:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444154240 00000100:00100000:1.0:1785219895.180194:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1785219895.180205:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+6:2361:x1871938444154240:12345-192.168.203.31@tcp:1:lfs.0 00010000:00010000:1.0:1785219895.180264:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.180291:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.180319:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1785219895.180324:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785219895.180330:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.180403:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.180420:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 6 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219895.180438:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381106300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1871938465114752:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219895.180554:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219895.184826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219895.184927:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444154368 00000100:00100000:2.0:1785219895.184940:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444154368 00002000:00100000:2.0:1785219895.185011:0:12017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cf381106d80 x1871938444154368/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:511/0 lens 504/0 e 0 to 0 dl 1785219906 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785219895.185025:0:12017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381106d80 with x1871938444154368 ext(0->8) 00010000:00010000:2.0:1785219895.185037:0:12017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 7 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.185058:0:12017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 7 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785219895.185068:0:12017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf381106d80 00000100:00100000:2.0:1785219895.185144:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1785219895.185156:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444154368:12345-192.168.203.31@tcp:4:lfs.0 00000100:00100000:2.0:1785219895.185899:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2362:x1871938444154368:12345-192.168.203.31@tcp:4:lfs.0 Request processed in 741us (1083us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1785219895.185910:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00002000:00100000:2.0:1785219895.185919:0:12017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cf381106d80 x1871938444154368/t4294967308(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:511/0 lens 504/448 e 0 to 0 dl 1785219906 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785219895.185930:0:12017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381106d80 with x1871938444154368 ext(0->8) 00010000:00010000:2.0:1785219895.185939:0:12017:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 9 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.185961:0:12017:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 9 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785219895.185970:0:12017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf381106d80 00000100:00100000:3.0:1785219895.187404:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381106300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1871938465114752:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219895.187440:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219895.189633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219895.190009:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444154496 00000100:00100000:2.0:1785219895.190021:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444154496 00010000:00010000:2.0:1785219895.190081:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 9 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219895.190222:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1785219895.190234:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2361:x1871938444154496:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219895.190253:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785219895.190278:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1785219895.190281:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785219894 00002000:00010000:2.0:1785219895.190284:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785219894 00002000:00010000:2.0:1785219895.190286:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1785219894 00010000:00010000:2.0:1785219895.190293:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 9 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.190309:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 9 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.190341:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082e6144a/0x8b38d407a078d515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f61e expref: 9 pid: 6589 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.190426:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219895.190432:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219895.190439:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.190450:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.190494:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219895.190572:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444154496:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 340us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219895.190580:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00010000:00010000:1.0:1785219895.190819:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190830:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190862:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190881:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190907:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190915:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219895.190920:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190929:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190945:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.190953:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c283c960/0x8b38d407a078d554 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219895.191031:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444154240:12345-192.168.203.31@tcp:1:lfs.0 Request processed in 10826us (11045us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219895.191040:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1785219895.194328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219895.194449:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444154752 00000100:00100000:2.0:1785219895.194462:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444154752 00000100:00100000:2.0:1785219895.194595:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 56 00000100:00100000:2.0:1785219895.194607:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+43:11596:x1871938444154752:12345-192.168.203.31@tcp:35:lfs.0 00000004:00010000:2.0:1785219895.194685:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f633 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785219895.195025:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1785219895.195090:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1785219895.195712:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1785219895.195801:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.195822:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 47 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.195851:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.195899:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 47 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.195918:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 47 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219895.195937:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f7bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1871938465114880:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219895.196054:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219895.199098:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f7bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1871938465114880:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219895.199150:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219895.201078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.201467:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444154880 00000100:00100000:3.0:1785219895.201480:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444154880 00010000:00010000:3.0:1785219895.201533:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 48 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219895.201581:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:3.0:1785219895.201593:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+48:2362:x1871938444154880:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219895.201611:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219895.201620:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 48 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.201654:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 48 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.201680:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28400/0x8b38d407a078d500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f610 expref: 48 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.201700:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:3.0:1785219895.201706:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.201715:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.201724:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.201766:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219895.201828:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.201840:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219895.201848:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+47:2362:x1871938444154880:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 256us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.201856:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000001:00080000:1.0:1785219895.202018:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1785219895.202330:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1785219895.204148:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465115008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1785219895.204251:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219895.204297:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4000 going to sleep for 11 seconds 00000100:00100000:0.0:1785219895.204312:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465115008 00000100:00100000:0.0:1785219895.204325:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465115008 00000100:00100000:0.0:1785219895.204589:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785219895.204625:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1871938465115008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1785219895.204758:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1871938465115008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 137us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219895.204768:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785219895.205443:0:5797:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1785219895.205452:0:5797:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1785219895.205475:0:5797:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf37f13c000, transno 4294967307 00000100:00100000:1.0:1785219895.205499:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465115008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1785219895.206577:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1785219895.206720:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465115136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1785219895.206815:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219895.207346:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3480099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219895.207463:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465115136 00000100:00100000:0.0:1785219895.207474:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465115136 00000100:00100000:0.0:1785219895.207534:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219895.207544:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1871938465115136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1785219895.207799:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1871938465115136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 256us (983us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1785219895.207807:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785219895.207965:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1871938465115136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1785219895.208043:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1785219895.208274:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.208289:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.208298:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.208306:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219895.208311:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.208320:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.208548:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:1.0:1785219895.208552:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1785219895.208559:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.208567:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078d55b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785219895.208716:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1785219895.209283:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1785219895.209670:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1785219895.209685:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388062320182ns, next at 389062316619ns, rc = 0 00000001:00080000:0.0:1785219895.209696:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1785219895.209755:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf34a6a9c00) 00010000:00010000:0.0:1785219895.209760:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785219895.209771:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28c00/0x8b38d407a078d546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f633 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219895.210061:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:11596:x1871938444154752:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 15443us (15734us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1785219895.210073:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 56 00000020:00080000:0.0:1785219895.210081:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1785219895.215530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.215700:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444155008 00000100:00100000:3.0:1785219895.215715:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444155008 00000100:00100000:3.0:1785219895.215801:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:3.0:1785219895.215814:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+50:11596:x1871938444155008:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219895.215847:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219895.215887:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f63a expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.215999:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f63a expref: 51 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.216017:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f63a expref: 51 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.216039:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219895.216043:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219895.216048:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07400, rc 0) 00000100:00100000:3.0:1785219895.216243:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:11596:x1871938444155008:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 432us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.216251:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 203 00000100:00100000:2.0:1785219895.220511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.220633:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444155264 00000100:00100000:1.0:1785219895.220648:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444155264 00000100:00100000:1.0:1785219895.221270:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:1.0:1785219895.221284:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+51:11596:x1871938444155264:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219895.221657:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:11596:x1871938444155264:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 376us (1164us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1785219895.221665:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 57 00000100:00100000:0.0:1785219895.327536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.327854:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444155392 00000100:00100000:3.0:1785219895.327866:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444155392 00000100:00100000:3.0:1785219895.327998:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:3.0:1785219895.328011:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:11606:x1871938444155392:12345-192.168.203.31@tcp:34:lfs.0 00010000:00010000:3.0:1785219895.328300:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328325:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328341:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328398:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328437:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328445:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328594:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328604:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328611:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785219895.328675:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328691:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328698:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328706:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328714:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219895.328719:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328728:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328750:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219895.328753:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219895.328760:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328767:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328794:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328801:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328806:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328812:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219895.328814:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328820:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328827:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf356788000) 00010000:00010000:3.0:1785219895.328829:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219895.328833:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328838:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328868:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328874:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328880:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328885:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219895.328888:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328894:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328901:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219895.328903:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219895.328906:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.328911:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219895.329023:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:11606:x1871938444155392:12345-192.168.203.31@tcp:34:lfs.0 Request processed in 1011us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.329032:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 204 00000100:00100000:2.0:1785219895.374150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.374305:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444155648 00000100:00100000:3.0:1785219895.374320:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444155648 00000100:00100000:3.0:1785219895.374435:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:3.0:1785219895.374466:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+52:11609:x1871938444155648:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219895.374496:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219895.374525:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d57e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f641 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374626:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374646:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374660:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374678:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374685:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374693:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374897:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374907:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.374915:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219895.374939:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1785219895.375078:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375087:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375095:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375102:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219895.375107:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375116:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375143:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219895.375146:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219895.375151:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375158:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375173:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375180:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375197:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375202:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219895.375205:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375212:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375220:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf356788000) 00010000:00010000:3.0:1785219895.375222:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219895.375225:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375232:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d58c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375286:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d57e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375303:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 54 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.375311:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219895.375313:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219895.375316:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030200, rc 0) 00000100:00100000:3.0:1785219895.375491:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:11609:x1871938444155648:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1027us (1358us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1785219895.375510:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 205 00000100:00100000:2.0:1785219895.379798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.379904:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444155776 00000100:00100000:1.0:1785219895.379917:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444155776 00000100:00100000:1.0:1785219895.379988:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:1.0:1785219895.380001:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:11609:x1871938444155776:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:1.0:1785219895.380167:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380189:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380204:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380321:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380330:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380338:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380345:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219895.380350:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380359:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380423:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:1.0:1785219895.380427:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785219895.380432:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.380439:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219895.380534:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:11609:x1871938444155776:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 534us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219895.380543:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 206 00000100:00100000:2.0:1785219895.383700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.384061:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444156032 00000100:00100000:1.0:1785219895.384075:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444156032 00000100:00100000:1.0:1785219895.384408:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:1.0:1785219895.384440:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+54:11609:x1871938444156032:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:1.0:1785219895.384761:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:11609:x1871938444156032:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 322us (1076us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1785219895.384769:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 58 00000100:00100000:2.0:1785219895.476724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.476829:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444156288 00000100:00100000:3.0:1785219895.476843:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444156288 00000100:00100000:3.0:1785219895.476932:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:3.0:1785219895.476945:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:11619:x1871938444156288:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785219895.476978:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219895.476981:0:8055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785219895.477018:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29e00/0x8b38d407a078d523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f625 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.477042:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219895.477047:0:8055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785219895.477064:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d5a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f648 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.477440:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.477459:0:8055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.477470:0:8055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.477511:0:8055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.477529:0:8055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 55 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219895.477566:0:8055:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381125500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465115264:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785219895.481622:0:8055:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf354f340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219895.483740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219895.483880:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444156416 00000100:00100000:0.0:1785219895.483909:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444156416 00010000:00010000:0.0:1785219895.483962:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 56 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219895.484012:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1785219895.484023:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:2361:x1871938444156416:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219895.484044:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219895.484052:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 56 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.484068:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 56 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.484097:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:0.0:1785219895.484104:0:6603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.484125:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.484135:0:6603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.484157:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219895.484225:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+56:2361:x1871938444156416:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 203us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219895.484233:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00010000:00010000:1.0:1785219895.485820:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f641 expref: 55 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219895.486796:0:8055:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381125500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8055:1871938465115264:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219895.486834:0:8055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.486847:0:8055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.486854:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219895.486946:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1785219895.487528:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d5a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 56 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.487554:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 55 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.487566:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:1.0:1785219895.487569:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219895.487574:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:1.0:1785219895.487665:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:11619:x1871938444156288:12345-192.168.203.31@tcp:101:bash.0 Request processed in 10723us (10955us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1785219895.487695:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 207 00000100:00100000:2.0:1785219895.491465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.491590:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444156672 00000100:00100000:1.0:1785219895.491603:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444156672 00000100:00100000:1.0:1785219895.491710:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 208 00000100:00100000:1.0:1785219895.491723:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+55:11619:x1871938444156672:12345-192.168.203.31@tcp:36:bash.0 00010000:00010000:1.0:1785219895.492117:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.492141:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.492156:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785219895.492217:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1785219895.492244:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd3f70a8 reply state 00000000c3dd8d91 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219895.492254:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785219895.492404:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:11619:x1871938444156672:12345-192.168.203.31@tcp:36:bash.0 Request processed in 681us (953us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1785219895.492412:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 208 00000020:00080000:1.0:1785219895.492418:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785219895.494906:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.494955:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.494964:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.494972:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219895.494978:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.494987:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.495009:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:0.0:1785219895.495013:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219895.495019:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.495026:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29400/0x8b38d407a078d5bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219895.497820:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.498022:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444156800 00000100:00100000:1.0:1785219895.498035:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444156800 00000100:00100000:1.0:1785219895.498116:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:1.0:1785219895.498129:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:11619:x1871938444156800:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:1.0:1785219895.498161:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219895.498198:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d5c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f64f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.498309:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.498327:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 58 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.498338:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.498423:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 58 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.498439:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 58 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219895.498455:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465115392:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219895.498558:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3480099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219895.502658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.502757:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444156928 00000100:00100000:3.0:1785219895.502771:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444156928 00010000:00010000:3.0:1785219895.502838:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 59 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219895.502895:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1785219895.502907:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:2361:x1871938444156928:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219895.502929:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219895.502939:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 59 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.502956:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 59 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.502988:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219895.502995:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.503008:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.503017:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.503080:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219895.503171:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:2361:x1871938444156928:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 265us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.503180:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00010000:00010000:1.0:1785219895.504475:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5af lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f648 expref: 58 pid: 8055 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219895.504507:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465115392:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219895.504541:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.505799:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.505843:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219895.505963:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1785219895.505968:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219895.505998:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.506163:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29600/0x8b38d407a078d5c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.506191:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.506201:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:2.0:1785219895.506204:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219895.506207:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29000, rc 0) 00000100:00100000:2.0:1785219895.506347:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:11619:x1871938444156800:12345-192.168.203.31@tcp:101:bash.0 Request processed in 8220us (8542us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219895.506358:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 209 00000100:00100000:2.0:1785219895.512182:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.512280:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444157184 00000100:00100000:1.0:1785219895.512294:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444157184 00000100:00100000:1.0:1785219895.512490:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:1.0:1785219895.512502:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+57:11619:x1871938444157184:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:1.0:1785219895.512832:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:11619:x1871938444157184:12345-192.168.203.31@tcp:35:bash.0 Request processed in 331us (728us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1785219895.512840:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 59 00000100:00100000:0.0:1785219895.592928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.593037:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444157312 00000100:00100000:3.0:1785219895.593063:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444157312 00000100:00100000:3.0:1785219895.593147:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:3.0:1785219895.593160:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+58:11625:x1871938444157312:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219895.593196:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219895.593225:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d5d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f656 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.593315:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.593334:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.593348:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219895.593482:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1785219895.593487:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219895.593515:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.593551:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078d5d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f656 expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.593605:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f656 expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.593616:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219895.593620:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219895.593624:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:3.0:1785219895.593718:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:11625:x1871938444157312:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 559us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.593731:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 210 00000100:00100000:2.0:1785219895.598689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.599792:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444157440 00000100:00100000:3.0:1785219895.599811:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444157440 00000100:00100000:3.0:1785219895.600002:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:3.0:1785219895.600015:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:11625:x1871938444157440:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785219895.600045:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219895.600085:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d5e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f65d expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600183:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600202:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600216:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600236:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600263:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600271:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600438:0:8055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d5f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600448:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600456:0:8055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785219895.600505:0:8055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1785219895.600511:0:8055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785219895.600537:0:8055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600551:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600560:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600568:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600575:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600594:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219895.600599:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600608:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600624:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219895.600627:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219895.600633:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600639:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078d5e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600656:0:8055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600662:0:8055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600668:0:8055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600673:0:8055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219895.600676:0:8055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600682:0:8055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600951:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf356788000) 00010000:00010000:3.0:1785219895.600953:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219895.600957:0:8055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.600963:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d5ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.601007:0:8055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078d5e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f65d expref: 61 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.601024:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f65d expref: 60 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.601032:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219895.601035:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219895.601038:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07c00, rc 0) 00000100:00100000:3.0:1785219895.601284:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:11625:x1871938444157440:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1271us (2608us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.601294:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 211 00000100:00100000:2.0:1785219895.608882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219895.609091:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444157824 00000100:00100000:0.0:1785219895.609106:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444157824 00000100:00100000:0.0:1785219895.609196:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1785219895.609208:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:2361:x1871938444157824:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219895.609230:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219895.609266:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d5f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f65d expref: 60 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.609315:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:0.0:1785219895.609321:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219895.609485:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:2361:x1871938444157824:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 279us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219895.609493:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:2.0:1785219895.613175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.615005:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444157696 00000100:00100000:3.0:1785219895.615026:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444157696 00000100:00100000:2.0:1785219895.615588:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:2.0:1785219895.615602:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:11625:x1871938444157696:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785219895.615632:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219895.615678:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d5fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.615840:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.615858:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.616003:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.616053:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219895.616070:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 60 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219895.616086:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465115520:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219895.616269:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219895.622354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219895.622533:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465115520:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219895.622583:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219895.622847:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444157952 00000100:00100000:3.0:1785219895.622859:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444157952 00010000:00010000:3.0:1785219895.622984:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 61 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219895.623127:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1785219895.623160:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:2362:x1871938444157952:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219895.623182:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219895.623190:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 61 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.623205:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 61 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.623236:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29000/0x8b38d407a078d5cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f64f expref: 61 pid: 5793 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.623257:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219895.623262:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.623274:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.623282:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.623311:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219895.623549:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.623558:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219895.623583:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1785219895.623923:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8400/0x8b38d407a078d5fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 62 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.623944:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219895.623953:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:1.0:1785219895.623956:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785219895.623959:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8e00, rc 0) 00000100:00100000:3.0:1785219895.624027:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:2362:x1871938444157952:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 867us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219895.624037:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1785219895.626052:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:11625:x1871938444157696:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 10434us (12997us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1785219895.626068:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 212 00000100:00100000:2.0:1785219895.630676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219895.630827:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444158208 00000100:00100000:0.0:1785219895.630840:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444158208 00000100:00100000:0.0:1785219895.630935:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1785219895.630946:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:11625:x1871938444158208:12345-192.168.203.31@tcp:103:lfs.0 00010000:00010000:0.0:1785219895.630966:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219895.630997:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f63a expref: 60 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.631017:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:0.0:1785219895.631023:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219895.631103:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:11625:x1871938444158208:12345-192.168.203.31@tcp:103:lfs.0 Request processed in 158us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219895.636412:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1785219895.648523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219895.649121:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444158336 00000100:00100000:3.0:1785219895.649136:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444158336 00000100:00100000:3.0:1785219895.649224:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 213 00000100:00100000:3.0:1785219895.649235:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:11625:x1871938444158336:12345-192.168.203.31@tcp:58:lfs.0 00010000:00010000:3.0:1785219895.649443:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.649468:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219895.649485:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785219895.650647:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1785219895.650855:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:11625:x1871938444158336:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 1616us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219895.650877:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 213 00010000:00010000:0.0:1785219895.661840:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219895.664929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219895.665247:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444158464 00000100:00100000:0.0:1785219895.665262:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444158464 00000100:00100000:0.0:1785219895.665340:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 214 00000100:00100000:0.0:1785219895.665351:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+59:11625:x1871938444158464:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785219895.665420:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219895.665456:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f66b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.665536:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.665549:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.665572:0:5794:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.665586:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.665660:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:0.0:1785219895.665664:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785219895.665669:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219895.665678:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0a00, rc 0) 00000100:00100000:0.0:1785219895.665759:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:11625:x1871938444158464:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 409us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219895.665767:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 214 00000040:00080000:3.0:1785219896.365233:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785219896.365249:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785219896.365300:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1785219896.365315:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785219896.365987:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381124380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465115648:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785219896.366142:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e4e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219896.389099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.389209:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444158592 00000100:00100000:2.0:1785219896.389222:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444158592 00000100:00100000:2.0:1785219896.389335:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:2.0:1785219896.389348:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444158592:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1785219896.389614:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1785219896.389709:0:8055:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1785219896.389862:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444158592:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 516us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.389871:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 215 00000100:00100000:3.0:1785219896.390240:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381124380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465115648:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785219896.398201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219896.398484:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444158720 00000100:00100000:0.0:1785219896.398507:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444158720 00000100:00100000:0.0:1785219896.398588:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:0.0:1785219896.398602:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:11627:x1871938444158720:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1785219896.398728:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398750:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398770:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398802:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398810:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398817:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398845:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398854:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398859:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219896.398910:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1785219896.398916:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219896.398933:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398945:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398958:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398965:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398972:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219896.398977:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398986:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.398999:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:0.0:1785219896.399003:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219896.399008:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399014:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1400/0x8b38d407a078d61f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399029:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399035:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399041:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399047:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219896.399057:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399063:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399071:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9cf342843e00) 00010000:00010000:0.0:1785219896.399074:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219896.399077:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399083:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d626 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399113:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399120:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399126:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399131:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219896.399135:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399140:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399147:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:0.0:1785219896.399150:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219896.399159:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.399166:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d62d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219896.399265:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:11627:x1871938444158720:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 665us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219896.399273:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 216 00000100:00100000:3.0:1785219896.402417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.403550:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444158976 00000100:00100000:2.0:1785219896.403566:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444158976 00000100:00100000:2.0:1785219896.403660:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:2.0:1785219896.403674:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+60:11627:x1871938444158976:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.403702:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219896.403732:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d634 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f672 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.403881:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.403901:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.403915:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219896.403929:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1785219896.404050:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404059:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404087:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404094:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219896.404099:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404108:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404122:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:2.0:1785219896.404126:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785219896.404131:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404138:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d63b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404186:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d634 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f672 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404196:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:2.0:1785219896.404199:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785219896.404203:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d634 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f672 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.404212:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8c00, rc 0) 00000100:00100000:2.0:1785219896.404290:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444158976:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 620us (1889us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1785219896.404307:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 217 00000100:00100000:3.0:1785219896.412588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.412783:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444159104 00000100:00100000:1.0:1785219896.412797:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444159104 00000100:00100000:1.0:1785219896.412937:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:1.0:1785219896.412951:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444159104:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785219896.413014:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785219896.413165:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444159104:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 217us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.413175:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 218 00000100:00100000:0.0:1785219896.416760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.416869:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444159360 00000100:00100000:2.0:1785219896.416883:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444159360 00000100:00100000:2.0:1785219896.416955:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:2.0:1785219896.416968:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444159360:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.417006:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219896.417010:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785219896.417047:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078d5d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f656 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.417071:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:2.0:1785219896.417076:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219896.417104:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f679 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785219896.417934:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1785219896.418696:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.418717:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.418728:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.418809:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f679 expref: 63 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.418853:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f679 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.418863:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:2.0:1785219896.418866:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785219896.418869:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9200, rc 0) 00000100:00100000:2.0:1785219896.419069:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+62:11627:x1871938444159360:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 2103us (2323us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1785219896.419079:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 219 00000100:00100000:3.0:1785219896.425691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219896.425838:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444159616 00000100:00100000:0.0:1785219896.425855:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444159616 00000100:00100000:0.0:1785219896.425941:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:0.0:1785219896.425954:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+62:11627:x1871938444159616:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785219896.426043:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219896.426079:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f679 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426107:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd200) 00010000:00010000:0.0:1785219896.426122:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785219896.426150:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426168:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426180:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426198:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426225:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426233:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426340:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426348:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426355:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426530:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219896.426537:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426548:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426557:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:0.0:1785219896.426561:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219896.426566:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426573:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078d65e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426595:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426609:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426615:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426620:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219896.426624:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426631:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426639:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa956545 (ffff9cf342843e00) 00010000:00010000:0.0:1785219896.426642:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785219896.426645:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.426651:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d665 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa956545 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219896.426920:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444159616:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 965us (1240us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785219896.426929:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 220 00000100:00100000:3.0:1785219896.433502:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.433759:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444159744 00000100:00100000:2.0:1785219896.433772:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444159744 00000100:00100000:2.0:1785219896.433848:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:2.0:1785219896.433859:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+61:11627:x1871938444159744:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.433885:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219896.433917:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d66c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f680 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.433963:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.433989:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.434003:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.434141:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078d66c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 63 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.434173:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.434183:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219896.434187:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785219896.434191:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8000, rc 0) 00000100:00100000:2.0:1785219896.434270:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+62:11627:x1871938444159744:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 412us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.434279:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 221 00000100:00100000:2.0:1785219896.437888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219896.438552:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444160000 00000100:00100000:0.0:1785219896.438565:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444160000 00000100:00100000:0.0:1785219896.438647:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 222 00000100:00100000:0.0:1785219896.438659:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+62:11627:x1871938444160000:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785219896.438813:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.438840:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.438855:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785219896.439334:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1785219896.439346:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389291981164ns, next at 390291978166ns, rc = 0 00000004:00010000:0.0:1785219896.440314:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ea72fa4 reply state 00000000f2268ba5 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219896.440331:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785219896.440897:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+64:11627:x1871938444160000:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 2234us (3017us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1785219896.440909:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 222 00010000:00010000:0.0:1785219896.448090:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.448120:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.448129:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.448136:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785219896.448142:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.448156:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.448203:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:0.0:1785219896.448207:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785219896.448213:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.448220:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d67a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.449226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.449764:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444160128 00000100:00100000:3.0:1785219896.449787:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444160128 00000100:00100000:3.0:1785219896.449863:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:3.0:1785219896.449874:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+63:11627:x1871938444160128:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785219896.449905:0:8055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219896.449929:0:8055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f687 expref: -99 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.450023:0:8055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 64 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.450039:0:8055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 64 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.450059:0:8055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:3.0:1785219896.450063:0:8055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219896.450067:0:8055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07400, rc 0) 00000100:00100000:3.0:1785219896.450150:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+64:11627:x1871938444160128:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 278us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219896.450158:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 223 00000100:00100000:3.0:1785219896.454831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.455089:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444160256 00000100:00100000:2.0:1785219896.455111:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444160256 00000100:00100000:2.0:1785219896.455218:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1785219896.455231:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2362:x1871938444160256:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1785219896.455324:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219896.455711:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2362:x1871938444160256:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 482us (893us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1785219896.455720:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:0.0:1785219896.460081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.460235:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444160512 00000100:00100000:1.0:1785219896.460249:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444160512 00000100:00100000:1.0:1785219896.460330:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:1.0:1785219896.460344:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+64:11627:x1871938444160512:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785219896.460717:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+65:11627:x1871938444160512:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 375us (651us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1785219896.460725:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 60 00000100:00100000:0.0:1785219896.464890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.465173:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444160768 00000100:00100000:1.0:1785219896.465186:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444160768 00000100:00100000:1.0:1785219896.465260:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:1.0:1785219896.465273:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2458da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+65:11627:x1871938444160768:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785219896.465488:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2458da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+65:11627:x1871938444160768:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 217us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.465498:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 224 00000100:00100000:3.0:1785219896.470570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.470982:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444160896 00000100:00100000:2.0:1785219896.470997:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444160896 00000100:00100000:2.0:1785219896.471077:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:2.0:1785219896.471091:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+65:11627:x1871938444160896:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.472025:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219896.472393:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f68e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.472524:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d68f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.472543:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.472557:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219896.472611:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219896.472638:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.472675:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f68e expref: 67 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.472698:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d68f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f68e expref: 66 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.472709:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219896.472712:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785219896.472717:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9e00, rc 0) 00000100:00100000:2.0:1785219896.472955:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+66:11627:x1871938444160896:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1865us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.472965:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 225 00000100:00100000:2.0:1785219896.482870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.483315:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444161024 00000100:00100000:3.0:1785219896.483331:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444161024 00000100:00100000:3.0:1785219896.483464:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:2.0:1785219896.483584:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+10:2362:x1871938444161024:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.483630:0:8158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219896.483658:0:8158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f695 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785219896.483692:0:8158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a684b37, blocks: 0x1 00010000:00010000:2.0:1785219896.483718:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1785219896.483723:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219896.483736:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 11 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.483785:0:8158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 11 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.483801:0:8158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8c00, rc 0) 00000100:00100000:2.0:1785219896.484013:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:2362:x1871938444161024:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 536us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.484022:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:1.0:1785219896.488275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.488400:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444161280 00000100:00100000:2.0:1785219896.488413:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444161280 00000100:00100000:2.0:1785219896.488551:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:2.0:1785219896.488564:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+66:11627:x1871938444161280:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1785219896.488708:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+66:11627:x1871938444161280:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 147us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.488717:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 226 00000100:00100000:3.0:1785219896.500043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.500245:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444161408 00000100:00100000:2.0:1785219896.500277:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444161408 00000100:00100000:2.0:1785219896.500354:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1785219896.500410:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+11:11627:x1871938444161408:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.500435:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219896.500461:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f69c expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.500505:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 12 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.500516:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219896.500521:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219896.500527:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.500571:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 12 pid: 8158 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.500586:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 12 pid: 8158 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.500604:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465115776:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219896.500729:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7780 going to sleep for 11 seconds 00000100:00100000:2.0:1785219896.504529:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6586:1871938465115776:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219896.504583:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.504639:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8200, rc 0) 00000100:00100000:2.0:1785219896.504746:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:11627:x1871938444161408:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 4381us (4716us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.504757:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:1.0:1785219896.513328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.513703:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444161536 00000100:00100000:2.0:1785219896.513716:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444161536 00010000:00010000:2.0:1785219896.513783:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 12 pid: 8158 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.513892:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:2.0:1785219896.513904:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:2362:x1871938444161536:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219896.513925:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219896.513958:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 12 pid: 8158 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.513974:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 12 pid: 8158 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.514003:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d696 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f695 expref: 12 pid: 8158 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.514024:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219896.514029:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219896.514039:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.514069:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.514134:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.514151:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1871938465115904:192.168.203.31@tcp:105: 00000100:00100000:2.0:1785219896.514262:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219896.528724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.528840:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444161664 00000100:00100000:1.0:1785219896.528851:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444161664 00000100:00100000:2.0:1785219896.528867:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1871938465115904:192.168.203.31@tcp:105: 00010000:00010000:2.0:1785219896.528901:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1785219896.528919:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9cf38175a680 x1871938444161664/t0(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:512/0 lens 504/0 e 0 to 0 dl 1785219907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219896.528931:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf38175a680 with x1871938444161664 ext(0->12) 00002000:00010000:1.0:1785219896.528938:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf38175a680 00000100:00100000:1.0:1785219896.528976:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1785219896.528984:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:2362:x1871938444161536:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 15083us (15670us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.528986:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:2361:x1871938444161664:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1785219896.528996:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:1.0:1785219896.529619:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:2361:x1871938444161664:12345-192.168.203.31@tcp:4:lhsmtool_posix.0 Request processed in 631us (910us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1785219896.529629:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00002000:00100000:1.0:1785219896.529637:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9cf38175a680 x1871938444161664/t4294967320(0) o4->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:512/0 lens 504/448 e 0 to 0 dl 1785219907 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219896.529648:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf38175a680 with x1871938444161664 ext(0->12) 00002000:00010000:1.0:1785219896.529652:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf38175a680 00000100:00100000:0.0:1785219896.540730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.541044:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444161792 00000100:00100000:3.0:1785219896.541056:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444161792 00000100:00100000:3.0:1785219896.541187:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:3.0:1785219896.541210:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+66:11627:x1871938444161792:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1785219896.646785:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1785219896.646802:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000004:00080000:1.0:1785219896.646825:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1785219896.646843:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf356b59cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1785219896.646849:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37ef48600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf356b593c0 00000020:00080000:1.0:1785219896.646852:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37ef48400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf3505d9800 00000001:00080000:1.0:1785219896.646878:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1785219896.646903:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf2462e4000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1785219896.646906:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37c81d800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf2462e4900 00000020:00080000:1.0:1785219896.646928:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf37c81d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf381ed0c00 00000004:00080000:1.0:1785219896.647025:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1785219896.647574:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1785219896.647822:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1785219896.647849:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465116032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785219896.647947:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219896.648333:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465116160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1785219896.648392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219896.648417:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219896.648423:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465116288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785219896.648446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219896.648484:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465116032 00000100:00100000:1.0:1785219896.648493:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465116032 00000100:00100000:1.0:1785219896.648618:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465116160 00000100:00100000:1.0:1785219896.648622:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465116160 00000100:00100000:1.0:1785219896.648636:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465116288 00000100:00100000:1.0:1785219896.648639:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465116288 00000100:00100000:1.0:1785219896.648657:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1785219896.648666:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1871938465116032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785219896.648712:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1785219896.648746:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.648782:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.648794:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1785219896.648815:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785219896.648821:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.648858:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.648874:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 12 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219896.648887:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6588:1871938465116416:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219896.648960:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4780 going to sleep for 11 seconds 00000100:00100000:1.0:1785219896.648981:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785219896.648990:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465116160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1785219896.649460:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1785219896.649465:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1785219895 00002000:00010000:1.0:1785219896.649467:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785219896.649470:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1785219895 -> 1785219895 00002000:00010000:1.0:1785219896.649473:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1785219896.649532:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1871938465116160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 542us (1138us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1785219896.649540:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785219896.649567:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785219896.649575:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1871938465116288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785219896.649592:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1785219896.649619:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a684b36, atime: 0x6a684b36, ctime: 0x6a684b36, blocks: 0x1 00010000:00010000:1.0:1785219896.649632:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.649645:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1785219896.649649:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219896.649655:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.649673:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.649684:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.649707:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.649729:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785219896.652626:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1871938465116288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3037us (4163us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1785219896.652644:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1785219896.652687:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1785219896.654524:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf381a2ed80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1785219896.654542:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465116288:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1785219896.654561:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf381a2ce00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1785219896.654566:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465116160:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1785219896.654983:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219896.654996:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.655013:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219896.655026:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.655041:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.655109:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.655118:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f3a7b00/0x8b38d407a078d6ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.655149:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219896.655150:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219896.655152:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219896.655708:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11627:x1871938444161792:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 114494us (114986us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.655721:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 227 00000100:00100000:0.0:1785219896.660145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.661354:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444161920 00000100:00100000:2.0:1785219896.661389:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444161920 00010000:00010000:2.0:1785219896.661457:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 13 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.661507:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:2.0:1785219896.661519:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:2361:x1871938444161920:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219896.661540:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219896.661547:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 13 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.661563:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 13 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.661600:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219896.661605:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219896.661632:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.661644:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.661669:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219896.661953:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+13:2361:x1871938444161920:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 435us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.661962:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00010000:00010000:1.0:1785219896.664054:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b390f75/0x8b38d407a078d466 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5fb expref: 12 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219896.664134:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6588:1871938465116416:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219896.664171:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.664186:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.664194:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.664207:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.664216:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.664260:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785219896.665019:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1871938465116032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16349us (17068us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1785219896.665032:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1785219896.665244:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf381a2f100/2, rc 0, transno 4294967322 00000100:00100000:1.0:1785219896.665251:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465116032:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1785219896.665520:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219896.665531:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.665545:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219896.665551:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.665564:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.665590:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.665598:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c283c960/0x8b38d407a078d6a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.665641:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219896.665643:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219896.665645:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219896.666993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.667642:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444162048 00000100:00100000:1.0:1785219896.667656:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444162048 00000100:00100000:1.0:1785219896.667839:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:1.0:1785219896.667850:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:2361:x1871938444162048:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1785219896.684661:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219896.716613:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+12:2361:x1871938444162048:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 48749us (49616us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.716633:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000001:00080000:2.0:1785219896.717402:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1785219896.717421:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1785219896.725881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.726065:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444162304 00000100:00100000:2.0:1785219896.726081:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444162304 00000100:00100000:2.0:1785219896.726161:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 228 00000100:00100000:2.0:1785219896.726172:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11627:x1871938444162304:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.726269:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219896.726310:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d68f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f68e expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.726340:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219896.726346:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785219896.726459:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.726478:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.726491:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785219896.726877:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008baa4990 reply state 0000000096b51c21 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.726890:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785219896.727058:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:11627:x1871938444162304:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 884us (1192us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1785219896.727068:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 228 00010000:00010000:2.0:1785219896.731567:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.731593:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.731602:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.731611:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219896.731618:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.731627:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.731649:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219896.731653:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785219896.731660:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.731666:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219896.740318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.740982:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444162432 00000100:00100000:2.0:1785219896.740998:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444162432 00000100:00100000:2.0:1785219896.741085:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:2.0:1785219896.741097:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444162432:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785219896.741519:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1785219896.741524:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1785219895 -> 1785219894 00002000:00010000:2.0:1785219896.741527:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1785219894 00002000:00010000:2.0:1785219896.741530:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1785219895 -> 1785219894 00002000:00010000:2.0:1785219896.741533:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1785219896.741626:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2362:x1871938444162432:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 531us (1321us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1785219896.741636:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1785219896.752512:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.752629:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444162688 00000100:00100000:2.0:1785219896.752643:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444162688 00000100:00100000:2.0:1785219896.752723:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:2.0:1785219896.752738:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11627:x1871938444162688:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.752858:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.752883:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.752894:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.752955:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.752972:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 20 pid: 5793 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.753019:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465116544:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219896.753158:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219896.757212:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1871938465116544:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219896.757255:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219896.757725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.758200:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444162816 00000100:00100000:3.0:1785219896.758211:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444162816 00010000:00010000:3.0:1785219896.758263:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 21 pid: 5793 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219896.758331:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1785219896.758342:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381758700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:2361:x1871938444162816:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219896.758509:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219896.758521:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 21 pid: 5793 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.758537:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 21 pid: 5793 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.758569:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078d673 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f680 expref: 21 pid: 5793 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.758589:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:3.0:1785219896.758594:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.758607:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.758616:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.758681:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219896.758760:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381758700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:2361:x1871938444162816:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 419us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219896.758769:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00010000:00010000:2.0:1785219896.759637:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759651:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759691:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759699:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759707:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759714:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219896.759719:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759727:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759742:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219896.759759:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1785219896.759765:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.759783:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.759998:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11627:x1871938444162688:12345-192.168.203.31@tcp:55:lhsmtool_posix.0 Request processed in 7260us (7498us total) trans 0 rc -22/-22 00000100:00100000:2.0:1785219896.760009:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 229 00000100:00100000:0.0:1785219896.777211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.777336:0:8158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444162944 00000100:00100000:2.0:1785219896.777349:0:8158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444162944 00000100:00100000:2.0:1785219896.777641:0:8158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:2.0:1785219896.777655:0:8158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2362:x1871938444162944:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.777730:0:8158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.777759:0:8158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.777769:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219896.777785:0:8158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785219896.777791:0:8158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.777841:0:8158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.777885:0:8158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 8 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.777913:0:8158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8158:1871938465116672:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219896.778021:0:8158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219896.780738:0:8158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8158:1871938465116672:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219896.780784:0:8158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219896.782543:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.782833:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444163072 00000100:00100000:3.0:1785219896.782861:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444163072 00010000:00010000:3.0:1785219896.782985:0:6603:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 9 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219896.783041:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1785219896.783053:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+9:2362:x1871938444163072:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219896.783074:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219896.783229:0:6603:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 9 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.783245:0:6603:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 9 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.783278:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001908e3eb/0x8b38d407a078d69d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f69c expref: 9 pid: 6586 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.783302:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219896.783306:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785219896.783313:0:6603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.783324:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.783447:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219896.783698:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2362:x1871938444163072:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 645us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219896.783721:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00010000:00010000:2.0:1785219896.784261:0:8158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784276:0:8158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784315:0:8158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784325:0:8158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784333:0:8158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784357:0:8158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219896.784567:0:8158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784580:0:8158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784601:0:8158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.784610:0:8158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d21b463/0x8b38d407a078d6c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.785010:0:8158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2362:x1871938444162944:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 7352us (7815us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219896.785022:0:8158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 70 00000100:00100000:0.0:1785219896.805703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.805817:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444163328 00000100:00100000:2.0:1785219896.805830:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444163328 00000100:00100000:2.0:1785219896.805927:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 230 00000100:00100000:2.0:1785219896.805939:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11627:x1871938444163328:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.806075:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.806106:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.806148:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.808698:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.808743:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 20 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.808755:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.808823:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 20 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.808847:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 20 pid: 8055 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.808868:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465116800:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785219896.810332:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219896.819886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.827257:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465116800:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785219896.827301:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219896.831551:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444163456 00000100:00100000:1.0:1785219896.831572:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444163456 00010000:00010000:1.0:1785219896.831651:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 21 pid: 8055 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219896.831707:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:1.0:1785219896.831718:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:2362:x1871938444163456:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219896.831737:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219896.831745:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 21 pid: 8055 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.831759:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 21 pid: 8055 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.831800:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f687 expref: 21 pid: 8055 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.831822:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:1.0:1785219896.831827:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.831838:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.831875:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.832169:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219896.832245:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:2362:x1871938444163456:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 527us (12389us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.832255:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00010000:00010000:2.0:1785219896.832398:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.832407:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785219896.832666:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1785219896.832847:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1785219896.833260:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1785219896.833417:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5795:1871938465116928:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785219896.833552:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219896.833596:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219896.834216:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465116928 00000100:00100000:0.0:1785219896.834242:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465116928 00000100:00100000:0.0:1785219896.834308:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219896.834319:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1871938465116928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785219896.834493:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1871938465116928:12345-0@lo:1000:mdt00_002.0 Request processed in 175us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219896.834501:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785219896.835274:0:5795:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1785219896.835284:0:5795:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1785219896.835308:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf381a2ce00, transno 4294967321 00000004:00080000:2.0:1785219896.835325:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf381a2f100, transno 4294967322 00000100:00100000:2.0:1785219896.835333:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5795:1871938465116928:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1785219896.837392:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1785219896.839805:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5795:1871938465117056:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785219896.840602:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219896.840657:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348009900 going to sleep for 11 seconds 00000100:00100000:0.0:1785219896.840701:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465117056 00000100:00100000:0.0:1785219896.840712:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465117056 00000100:00100000:0.0:1785219896.840794:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785219896.840805:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1871938465117056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785219896.841525:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5795:x1871938465117056:12345-0@lo:1000:mdt00_002.0 Request processed in 718us (922us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1785219896.841536:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785219896.841659:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5795:1871938465117056:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1785219896.841800:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.841813:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.841822:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.841829:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219896.841834:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.841870:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.841891:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219896.841895:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785219896.843282:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.843304:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078d6ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.843361:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.843407:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.843415:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.843421:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219896.843426:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.844357:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.844428:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:2.0:1785219896.844645:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785219896.844660:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.844807:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.844820:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.845013:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.845036:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465117184:192.168.203.31@tcp:105: 00000100:00100000:2.0:1785219896.845248:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219896.851054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.851428:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444163584 00000100:00100000:1.0:1785219896.851443:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444163584 00000100:00100000:1.0:1785219896.851522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:1.0:1785219896.851535:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11625:x1871938444163584:12345-192.168.203.31@tcp:49:lfs.0 00000100:00100000:0.0:1785219896.852129:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11625:x1871938444163584:12345-192.168.203.31@tcp:49:lfs.0 Request processed in 592us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219896.852138:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 61 00000100:00100000:0.0:1785219896.855160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.855260:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444163840 00000100:00100000:3.0:1785219896.855274:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444163840 00000100:00100000:3.0:1785219896.855352:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:3.0:1785219896.855401:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11625:x1871938444163840:12345-192.168.203.31@tcp:58:lfs.0 00000040:00080000:3.0:1785219896.855982:0:8055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1785219896.856224:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11625:x1871938444163840:12345-192.168.203.31@tcp:58:lfs.0 Request processed in 859us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219896.856234:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 231 00000100:00100000:2.0:1785219896.856560:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465117184:192.168.203.31@tcp:105: 00010000:00010000:2.0:1785219896.856597:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.856609:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078d611 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856720:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856742:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856757:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856769:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856786:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856794:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856801:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219896.856816:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856826:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856842:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219896.856846:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219896.856850:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856923:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07c00/0x8b38d407a078d6d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856935:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856941:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856947:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856953:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219896.856956:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856963:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856972:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219896.856974:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785219896.856985:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.856991:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078d6c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219896.857271:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:11627:x1871938444163328:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 51332us (51581us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1785219896.857282:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 230 00000020:00080000:3.0:1785219896.857287:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1785219896.857599:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219896.857604:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219896.857665:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1785219896.857672:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785219896.857830:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465117312:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785219896.862808:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7480 going to sleep for 11 seconds 00000100:00100000:0.0:1785219896.864007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.864116:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444164096 00000100:00100000:2.0:1785219896.864130:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444164096 00000100:00100000:2.0:1785219896.864202:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 62 00000100:00100000:2.0:1785219896.864234:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+24:11627:x1871938444164096:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1785219896.865643:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1785219896.865796:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1785219896.866715:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1871938465117312:192.168.203.31@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1785219896.866981:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.867004:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.867019:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.867032:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.867056:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.867063:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.867087:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785219896.867582:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11627:x1871938444164096:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 3344us (3580us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1785219896.867595:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 62 00000020:00080000:0.0:1785219896.867605:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785219896.868104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.868307:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444164224 00000100:00100000:1.0:1785219896.868316:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444164224 00000100:00100000:1.0:1785219896.868407:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 232 00000100:00100000:1.0:1785219896.868419:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11628:x1871938444164224:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785219896.868462:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785219896.868567:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11628:x1871938444164224:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 151us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.868575:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 232 00010000:00010000:2.0:1785219896.869654:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219896.869670:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.869683:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219896.869688:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.869701:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.869723:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf345fcd000) 00010000:00010000:2.0:1785219896.869727:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785219896.869733:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.869740:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.869769:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219896.869783:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219896.869785:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219896.877862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219896.878570:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444164480 00000100:00100000:0.0:1785219896.878587:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444164480 00000100:00100000:0.0:1785219896.878674:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:0.0:1785219896.878687:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+25:11628:x1871938444164480:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785219896.878722:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219896.878756:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f6a3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.879019:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d6ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.879039:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d6ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.879055:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d6ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219896.879069:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1785219896.879349:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0c00/0x8b38d407a078d6e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6a3 expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.879511:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d6ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6a3 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219896.879523:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:0.0:1785219896.879527:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785219896.879532:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1e00, rc 0) 00000100:00100000:0.0:1785219896.879626:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:11628:x1871938444164480:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 941us (1781us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1785219896.879635:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 233 00000100:00100000:0.0:1785219896.889544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219896.890952:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444164736 00000100:00100000:2.0:1785219896.890970:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444164736 00000100:00100000:2.0:1785219896.891050:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 234 00000100:00100000:2.0:1785219896.891063:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+27:11628:x1871938444164736:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785219896.891179:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891225:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891241:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891541:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891549:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891558:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891565:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785219896.891570:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891579:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891595:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:2.0:1785219896.891600:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785219896.891605:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219896.891612:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078d6f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.891838:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:11628:x1871938444164736:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 776us (2311us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1785219896.891854:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 234 00000040:00080000:0.0:1785219896.892346:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785219896.892359:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785219896.893336:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1785219896.893352:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785219896.898116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.898309:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444164992 00000100:00100000:3.0:1785219896.898324:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444164992 00000100:00100000:3.0:1785219896.898440:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1785219896.898454:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+28:11628:x1871938444164992:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1785219896.898816:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:11628:x1871938444164992:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 364us (723us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1785219896.898825:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 63 00000100:00100000:3.0:1785219896.927280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219896.927427:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444165120 00000100:00100000:1.0:1785219896.927554:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444165120 00000100:00100000:1.0:1785219896.927639:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:1.0:1785219896.927652:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+29:11630:x1871938444165120:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219896.927691:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219896.927721:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d6ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f6aa expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.927854:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.927874:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.927891:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.927909:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.927917:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.927924:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.928819:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.928841:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.928851:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.928901:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.928934:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 30 pid: 5795 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219896.928955:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465117440:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219896.929087:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a06f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219896.935067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.935335:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1871938465117440:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785219896.935559:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219896.935707:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444165376 00000100:00100000:2.0:1785219896.935717:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444165376 00000100:00100000:2.0:1785219896.935797:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1785219896.935809:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:5573:x1871938444165376:12345-192.168.203.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1785219896.936148:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:5573:x1871938444165376:12345-192.168.203.31@tcp:35:ldlm_bl.0 Request processed in 340us (1096us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1785219896.936157:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 64 00000100:00100000:2.0:1785219896.943022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219896.947669:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444165504 00000100:00100000:3.0:1785219896.947691:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444165504 00010000:00010000:3.0:1785219896.947789:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 32 pid: 5795 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219896.947848:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:3.0:1785219896.947861:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:2362:x1871938444165504:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219896.947880:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219896.947888:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 32 pid: 5795 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.947904:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 32 pid: 5795 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.947934:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078d603 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f664 expref: 32 pid: 5795 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.947953:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219896.947959:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.947972:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.947980:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219896.948012:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219896.948113:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+31:2362:x1871938444165504:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 255us (5106us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219896.948122:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00010000:00010000:1.0:1785219896.948655:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948667:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219896.948731:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1785219896.948737:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785219896.948762:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948792:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948804:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948811:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948818:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948826:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219896.948843:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948853:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948867:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:1.0:1785219896.948871:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219896.948877:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948884:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948898:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948905:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948911:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948916:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785219896.948919:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948925:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948933:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf34a6a9200) 00010000:00010000:1.0:1785219896.948935:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785219896.948944:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.948951:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d70d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.949004:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28200/0x8b38d407a078d6ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6aa expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.949020:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6aa expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219896.949028:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:1.0:1785219896.949031:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785219896.949033:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28600, rc 0) 00000100:00100000:1.0:1785219896.949087:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:11630:x1871938444165120:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 21437us (21832us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219896.949105:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 235 00000100:00100000:0.0:1785219897.261481:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465117824:0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.261560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219897.261635:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785219897.261642:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465117952:0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.261671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219897.261703:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465117696:0@lo:400:kworker.0 00000100:00100000:3.0:1785219897.261739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219897.261778:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465118208:0@lo:400:kworker.0 00000100:00100000:3.0:1785219897.261813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219897.261833:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785219897.261839:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465117568:0@lo:400:kworker.0 00000100:00100000:3.0:1785219897.261880:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219897.261902:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465118080:0@lo:400:kworker.0 00000100:00100000:3.0:1785219897.261924:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219897.262607:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465117824 00000100:00100000:2.0:1785219897.262616:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465117824 00000100:00100000:2.0:1785219897.262714:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465117696 00000100:00100000:2.0:1785219897.262718:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465117696 00000100:00100000:2.0:1785219897.262732:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118080 00000100:00100000:2.0:1785219897.262735:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118080 00000100:00080000:3.0:1785219897.262759:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219897.262799:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465117952 00000100:00100000:3.0:1785219897.262812:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465117952 00000100:00100000:1.0:1785219897.262832:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118208 00000100:00100000:1.0:1785219897.262837:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118208 00000100:00100000:3.0:1785219897.262844:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1785219897.262867:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785219897.262874:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1871938465118208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219897.262944:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1871938465118208:12345-0@lo:400:kworker.0 Request processed in 69us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219897.262952:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785219897.262961:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1785219897.262972:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1871938465117952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.262975:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465117824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219897.262980:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465117568 00000100:00100000:1.0:1785219897.262985:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465117568 00000100:00100000:1.0:1785219897.263012:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1785219897.263020:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465117568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219897.263027:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1871938465117952:12345-0@lo:400:kworker.0 Request processed in 176us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219897.263033:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465117824:12345-0@lo:400:kworker.0 Request processed in 61us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219897.263038:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1785219897.263048:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1785219897.263061:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785219897.263069:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3309:x1871938465117568:12345-0@lo:400:kworker.0 Request processed in 49us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219897.263076:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1785219897.263080:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1785219897.263089:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465117568:0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.263091:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465117696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219897.263109:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465118208:0@lo:400:kworker.0 00000100:00100000:3.0:1785219897.263138:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465117696:0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.263140:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465117696:12345-0@lo:400:kworker.0 Request processed in 51us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219897.263150:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1785219897.263191:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465117952:0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.263204:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465117824:0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.263232:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1785219897.263240:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465118080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219897.263284:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465118080:12345-0@lo:400:kworker.0 Request processed in 40us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219897.263290:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1785219897.263319:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465118080:0@lo:400:kworker.0 00000100:00100000:2.0:1785219897.360590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219897.360644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219897.360685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219897.360797:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444165888 00000100:00100000:1.0:1785219897.360805:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444165760 00000100:00100000:0.0:1785219897.360809:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444165888 00000100:00100000:1.0:1785219897.360812:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444165760 00000100:00100000:3.0:1785219897.360871:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444165632 00000100:00100000:3.0:1785219897.360877:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444165632 00000100:00100000:1.0:1785219897.360893:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1785219897.360906:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2360:x1871938444165760:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219897.360914:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:3.0:1785219897.360925:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444165632:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219897.361037:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2360:x1871938444165760:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 134us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219897.361045:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:3.0:1785219897.361850:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444165632:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 924us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219897.361872:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 294 00000100:00100000:0.0:1785219897.362608:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00100000:0.0:1785219897.362619:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2359:x1871938444165888:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219897.362669:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2359:x1871938444165888:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 52us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219897.362677:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 148 00000100:00080000:2.0:1785219897.364586:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785219897.364757:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785219897.707711:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785219897.768289:0:12463:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785219897.768300:0:12463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785219897.768356:0:12463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1785219897.768377:0:12463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785219897.772797:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785219897.772824:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465118336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219897.772901:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219897.772964:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118336 00000100:00100000:1.0:1785219897.772973:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118336 00000100:00100000:1.0:1785219897.773029:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785219897.773039:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465118336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219897.773080:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219897.773147:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465118336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219897.773155:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1785219897.773489:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465118336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219897.969238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219897.970122:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444166144 00000100:00100000:1.0:1785219897.970135:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444166144 00000100:00100000:1.0:1785219897.970206:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:1.0:1785219897.970219:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+30:11653:x1871938444166144:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:1.0:1785219897.970244:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219897.970266:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d71b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f6b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219897.970762:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d722 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219897.970796:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219897.970809:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785219897.970822:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1785219897.970966:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a29c00/0x8b38d407a078d71b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6b1 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219897.970981:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6b1 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219897.970990:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:1.0:1785219897.970993:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785219897.970997:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28a00, rc 0) 00000100:00100000:1.0:1785219897.971058:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11653:x1871938444166144:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 844us (1831us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1785219897.971065:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 236 00000100:00100000:1.0:1785219897.974951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219897.975013:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444166272 00000100:00100000:3.0:1785219897.975022:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444166272 00000100:00100000:3.0:1785219897.975077:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:3.0:1785219897.975086:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11653:x1871938444166272:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:3.0:1785219897.975215:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975232:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975243:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975272:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975279:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975287:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975306:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785219897.975311:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975319:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975334:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219897.975338:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785219897.975343:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219897.975349:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07400/0x8b38d407a078d730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219897.976232:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+32:11653:x1871938444166272:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 1142us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219897.976243:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 237 00000100:00100000:2.0:1785219898.100939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219898.101050:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444166400 00000100:00100000:3.0:1785219898.101062:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444166400 00000100:00100000:3.0:1785219898.101136:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00100000:3.0:1785219898.101147:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2361:x1871938444166400:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:3.0:1785219898.101165:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219898.101185:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078d737 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f6b8 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785219898.101212:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a684b36, atime: 0x6a684b36, ctime: 0x6a684b36, blocks: 0xb 00010000:00010000:3.0:1785219898.101233:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1785219898.101262:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785219898.101272:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078d737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6b8 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219898.101292:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078d737 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6b8 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219898.101307:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07400, rc 0) 00000100:00100000:3.0:1785219898.101522:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2361:x1871938444166400:12345-192.168.203.31@tcp:101:cat.0 Request processed in 377us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219898.101529:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 71 00000100:00080000:0.0:1785219898.102077:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785219898.112704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219898.113032:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444166528 00000100:00100000:1.0:1785219898.113044:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444166528 00002000:00100000:1.0:1785219898.113093:0:12017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9cf381a2aa00 x1871938444166528/t0(0) o3->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:514/0 lens 488/0 e 0 to 0 dl 1785219909 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219898.113125:0:12017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381a2aa00 with x1871938444166528 ext(0->4095) 00002000:00010000:1.0:1785219898.113132:0:12017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381a2aa00 00000100:00100000:1.0:1785219898.113204:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1785219898.113213:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2362:x1871938444166528:12345-192.168.203.31@tcp:3:cat.0 00000100:00100000:1.0:1785219898.113471:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+8:2362:x1871938444166528:12345-192.168.203.31@tcp:3:cat.0 Request processed in 258us (777us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1785219898.113479:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00002000:00100000:1.0:1785219898.113486:0:12017:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9cf381a2aa00 x1871938444166528/t0(0) o3->3c48a627-3c4f-49d5-b2ec-dae54c1457bb@192.168.203.31@tcp:514/0 lens 488/4536 e 0 to 0 dl 1785219909 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785219898.113504:0:12017:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf381a2aa00 with x1871938444166528 ext(0->4095) 00002000:00010000:1.0:1785219898.113507:0:12017:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf381a2aa00 00010000:00010000:3.0:1785219898.732748:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785219898.874623:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1785219898.874652:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1785219898.874662:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1785219899.755617:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219899.820556:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465118464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219899.820674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219899.821002:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118464 00000100:00100000:1.0:1785219899.821014:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118464 00000100:00080000:0.0:1785219899.821166:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219899.821236:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1785219899.821248:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465118464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219899.822337:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219899.822473:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465118464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1224us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219899.822484:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1785219899.823251:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465118464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785219900.780024:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219901.804975:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785219901.947685:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:1.0:1785219901.947712:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1785219901.947724:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1785219901.947766:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1785219901.947788:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1785219901.951145:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf3672f7240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1785219901.951159:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf3487b0300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf3460f0c00 00000020:00080000:1.0:1785219901.951185:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9cf3487b0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf37f123400 00000020:00080000:2.0:1785219901.951223:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1785219901.951529:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1785219901.957573:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1785219901.957600:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:2.0:1785219902.380611:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465118592:0@lo:400:kworker.0 00000100:00100000:2.0:1785219902.380709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219902.380729:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465118720:0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.380777:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219902.380788:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465119104:0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.380798:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465119232:0@lo:400:kworker.0 00000100:00100000:2.0:1785219902.380812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219902.380823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219902.380843:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465118848:0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.380848:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465118976:0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.380869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219902.380882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219902.380902:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118720 00000100:00100000:3.0:1785219902.380911:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118720 00000100:00100000:2.0:1785219902.380914:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465119104 00000100:00100000:2.0:1785219902.380917:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465119104 00000100:00100000:2.0:1785219902.380960:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118848 00000100:00100000:2.0:1785219902.380963:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118848 00000100:00100000:0.0:1785219902.380986:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118592 00000100:00100000:0.0:1785219902.380990:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118592 00000100:00100000:0.0:1785219902.381022:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1785219902.381033:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465118592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219902.381103:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465118592:12345-0@lo:400:kworker.0 Request processed in 72us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219902.381111:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1785219902.383690:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1785219902.383722:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465119104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219902.387284:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1785219902.387317:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465118720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219902.387510:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465118720:12345-0@lo:400:kworker.0 Request processed in 211us (6732us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219902.387520:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1785219902.387663:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465119104:12345-0@lo:400:kworker.0 Request processed in 3959us (6850us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219902.387671:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1785219902.387688:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1785219902.387701:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465118848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.387754:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465118848:12345-0@lo:400:kworker.0 Request processed in 60us (6871us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219902.387760:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1785219902.387784:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465119232 00000100:00100000:3.0:1785219902.387795:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465119232 00000100:00100000:3.0:1785219902.387840:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465118976 00000100:00100000:3.0:1785219902.387844:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465118976 00000100:00100000:3.0:1785219902.387869:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1785219902.387874:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465119232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.387910:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465119232:12345-0@lo:400:kworker.0 Request processed in 36us (7086us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219902.387915:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1785219902.387926:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785219902.387932:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465118976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.387966:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465118976:12345-0@lo:400:kworker.0 Request processed in 34us (7095us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219902.387972:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785219902.388042:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1785219902.388051:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1785219902.388087:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465118976:0@lo:400:kworker.0 00000100:00100000:0.0:1785219902.388195:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465118720:0@lo:400:kworker.0 00000100:00100000:0.0:1785219902.388208:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1785219902.388213:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1785219902.388230:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf381a2ed80, transno 4294967310 00000100:00100000:0.0:1785219902.388253:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465119232:0@lo:400:kworker.0 00000100:00080000:0.0:1785219902.389492:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219902.389505:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785219902.389508:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219902.389707:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465118848:0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.389773:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465119104:0@lo:400:kworker.0 00000100:00100000:3.0:1785219902.389787:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465118592:0@lo:400:kworker.0 00000100:00100000:2.0:1785219902.492568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219902.492610:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219902.492650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219902.492669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219902.492702:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219902.492745:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444167040 00000100:00100000:2.0:1785219902.492756:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444167040 00000100:00100000:2.0:1785219902.492835:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444166912 00000100:00100000:2.0:1785219902.492838:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444166912 00000100:00100000:2.0:1785219902.492870:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:2.0:1785219902.492881:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444167040:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219902.492975:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2359:x1871938444167040:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219902.492983:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:2.0:1785219902.493002:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1785219902.493008:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2359:x1871938444166912:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219902.493035:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2359:x1871938444166912:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219902.493041:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:2.0:1785219902.493060:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444166784 00000100:00100000:2.0:1785219902.493064:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444166784 00000100:00100000:2.0:1785219902.493092:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444167168 00000100:00100000:2.0:1785219902.493095:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444167168 00000100:00100000:2.0:1785219902.493117:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1785219902.493124:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2359:x1871938444166784:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219902.493161:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2359:x1871938444166784:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219902.493167:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 152 00000100:00100000:2.0:1785219902.493178:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:2.0:1785219902.493184:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2359:x1871938444167168:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219902.493206:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2359:x1871938444167168:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219902.493222:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 153 00000100:00100000:0.0:1785219902.493789:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444166656 00000100:00100000:0.0:1785219902.493796:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444166656 00000100:00100000:0.0:1785219902.493834:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00100000:0.0:1785219902.493843:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444166656:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219902.493884:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2359:x1871938444166656:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 43us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219902.493891:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 296 00000100:00080000:0.0:1785219902.493926:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785219902.493933:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219902.493936:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785219902.830513:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219902.892124:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219902.892158:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465119360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219902.892296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219902.892615:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465119360 00000100:00100000:1.0:1785219902.892626:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465119360 00000100:00100000:1.0:1785219902.892696:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785219902.892708:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465119360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219902.892768:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219902.892838:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465119360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219902.892846:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1785219902.893083:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465119360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219903.002291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219903.002440:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444167296 00000100:00100000:3.0:1785219903.002454:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444167296 00000100:00100000:3.0:1785219903.002528:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 238 00000100:00100000:3.0:1785219903.002541:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11306:x1871938444167296:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1785219903.002709:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11306:x1871938444167296:12345-192.168.203.31@tcp:60:lhsmtool_posix.0 Request processed in 171us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219903.002719:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 238 00000040:00080000:3.0:1785219903.019976:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785219903.019989:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1785219903.020136:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219903.020270:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444167552 00000100:00100000:2.0:1785219903.020285:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444167552 00000100:00100000:2.0:1785219903.020353:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 65 00000100:00100000:2.0:1785219903.020385:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:11306:x1871938444167552:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785219903.020937:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:11306:x1871938444167552:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 571us (805us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1785219903.020947:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 65 00000040:00080000:3.0:1785219903.022277:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1785219903.022293:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785219903.236269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219903.238632:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444167680 00000100:00100000:0.0:1785219903.238657:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444167680 00000100:00100000:0.0:1785219903.239041:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 239 00000100:00100000:0.0:1785219903.239075:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:12104:x1871938444167680:12345-192.168.203.31@tcp:101:lsof.0 00010000:00010000:0.0:1785219903.239105:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219903.239137:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d73e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f6bf expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219903.239247:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d745 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219903.239266:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219903.239283:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785219903.239639:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785219903.239645:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1785219903.240929:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219903.240992:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0200/0x8b38d407a078d73e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6bf expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219903.241017:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6bf expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219903.241043:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:0.0:1785219903.241047:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785219903.241051:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0800, rc 0) 00000100:00100000:0.0:1785219903.241423:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:12104:x1871938444167680:12345-192.168.203.31@tcp:101:lsof.0 Request processed in 2293us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219903.241435:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 239 00010000:00010000:2.0:1785219903.851623:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219904.875789:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219904.939864:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785219904.939895:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465119488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219904.940000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219904.940240:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465119488 00000100:00100000:1.0:1785219904.940250:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465119488 00000100:00080000:0.0:1785219904.940337:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785219904.940351:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785219904.940390:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465119488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785219904.940448:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219904.940505:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465119488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219904.940514:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785219904.941352:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465119488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785219905.899626:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785219906.923500:0:12663:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:25:04 (1785219904) 00010000:00010000:3.0:1785219906.928601:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785219907.102089:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1785219907.102112:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1785219907.102464:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1785219907.102481:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1785219907.500323:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465119744:0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.500429:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465119616:0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.500509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219907.500568:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465120128:0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.500596:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219907.500645:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465119616 00000100:00100000:1.0:1785219907.500654:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465119616 00000100:00100000:1.0:1785219907.500721:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1785219907.500754:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465119616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.500817:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465119616:12345-0@lo:400:kworker.0 Request processed in 65us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219907.500824:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1785219907.500891:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465119616:0@lo:400:kworker.0 00000100:00100000:0.0:1785219907.501517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219907.501554:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465120256:0@lo:400:kworker.0 00000100:00100000:0.0:1785219907.501599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219907.501742:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120128 00000100:00100000:1.0:1785219907.501749:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120128 00000100:00100000:1.0:1785219907.501806:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465119744 00000100:00100000:1.0:1785219907.501809:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465119744 00000100:00100000:1.0:1785219907.501831:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1785219907.501839:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465120128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.501890:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465120128:12345-0@lo:400:kworker.0 Request processed in 51us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219907.501896:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1785219907.501922:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1785219907.501930:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465119744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.501965:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465119744:12345-0@lo:400:kworker.0 Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219907.501968:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465120000:0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.501977:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1785219907.502028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219907.502123:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785219907.502134:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38175a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465119872:0@lo:400:kworker.0 00000100:00100000:2.0:1785219907.502166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219907.502196:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465119872 00000100:00100000:2.0:1785219907.502201:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465119872 00000100:00100000:1.0:1785219907.502239:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465119744:0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.502276:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465120128:0@lo:400:kworker.0 00000100:00100000:2.0:1785219907.502296:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1785219907.502309:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465119872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219907.502355:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465119872:12345-0@lo:400:kworker.0 Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219907.502397:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1785219907.502439:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120256 00000100:00100000:2.0:1785219907.502443:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120256 00000100:00100000:2.0:1785219907.502477:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120000 00000100:00100000:2.0:1785219907.502537:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120000 00000100:00080000:0.0:1785219907.502572:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219907.502583:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785219907.502586:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219907.502628:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785219907.502638:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465120256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219907.502693:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465120256:12345-0@lo:400:kworker.0 Request processed in 57us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219907.502716:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785219907.502740:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1785219907.502741:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465120256:0@lo:400:kworker.0 00000100:00100000:2.0:1785219907.502750:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465120000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219907.502786:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465120000:12345-0@lo:400:kworker.0 Request processed in 39us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219907.502792:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1785219907.504030:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465119872:0@lo:400:kworker.0 00000100:00100000:2.0:1785219907.504048:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38175b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465120000:0@lo:400:kworker.0 00000100:00100000:1.0:1785219907.603439:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219907.603485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219907.603518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219907.603545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219907.603594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219907.603632:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444168192 00000100:00100000:1.0:1785219907.603644:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444168192 00000100:00100000:1.0:1785219907.603720:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444168064 00000100:00100000:1.0:1785219907.603724:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444168064 00000100:00100000:1.0:1785219907.603756:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1785219907.603769:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444168192:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219907.603817:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444167808 00000100:00100000:3.0:1785219907.603822:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444167808 00000100:00100000:3.0:1785219907.603850:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:3.0:1785219907.603857:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444167808:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219907.603858:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2360:x1871938444168192:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 93us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219907.603866:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1785219907.603885:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:1.0:1785219907.603891:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2360:x1871938444168064:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219907.603895:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2360:x1871938444167808:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 39us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219907.603901:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 298 00000100:00100000:1.0:1785219907.603916:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2360:x1871938444168064:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219907.603921:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:1.0:1785219907.603937:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444167936 00000100:00100000:1.0:1785219907.603941:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444167936 00000100:00100000:1.0:1785219907.603977:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444168320 00000100:00100000:1.0:1785219907.603980:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444168320 00000100:00100000:1.0:1785219907.603998:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:1.0:1785219907.604004:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2360:x1871938444167936:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219907.604040:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:2360:x1871938444167936:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 35us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219907.604048:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 157 00000100:00100000:1.0:1785219907.604060:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00100000:1.0:1785219907.604067:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2360:x1871938444168320:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219907.604099:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2360:x1871938444168320:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219907.604105:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 158 00000100:00080000:0.0:1785219907.604347:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785219907.604354:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785219907.604357:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785219907.948434:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219908.011618:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465120384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219908.011732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219908.011836:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120384 00000100:00100000:2.0:1785219908.011846:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120384 00000100:00100000:2.0:1785219908.011934:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785219908.011944:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465120384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785219908.012571:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219908.012661:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465120384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 717us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219908.012671:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1785219908.012787:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465120384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785219908.971601:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219909.995655:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219910.060554:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785219910.060586:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465120512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219910.060676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219910.060924:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120512 00000100:00100000:0.0:1785219910.060938:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120512 00000100:00100000:0.0:1785219910.061027:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785219910.061039:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465120512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785219910.061105:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219910.061168:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465120512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219910.061176:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1785219910.061288:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465120512:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785219910.061425:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785219911.021338:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219911.201890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219911.201980:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444168576 00000100:00100000:0.0:1785219911.201995:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444168576 00000100:00100000:0.0:1785219911.202091:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:0.0:1785219911.202106:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+19:12325:x1871938444168576:12345-192.168.203.31@tcp:35:umount.0 00000100:00080000:1.0:1785219911.202305:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219911.202872:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:12325:x1871938444168576:12345-192.168.203.31@tcp:35:umount.0 Request processed in 768us (993us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1785219911.202882:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 66 00000100:00100000:1.0:1785219911.206278:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219911.206626:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444168832 00000100:00100000:0.0:1785219911.206640:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444168832 00000100:00100000:0.0:1785219911.206770:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:0.0:1785219911.206783:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+20:12325:x1871938444168832:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:0.0:1785219911.207521:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:12325:x1871938444168832:12345-192.168.203.31@tcp:35:umount.0 Request processed in 736us (1253us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1785219911.207532:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 67 00000100:00100000:1.0:1785219911.212629:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219911.212791:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444169088 00000100:00100000:2.0:1785219911.212806:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444169088 00000100:00100000:2.0:1785219911.212876:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:2.0:1785219911.212889:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3449e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+21:12325:x1871938444169088:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:2.0:1785219911.213559:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3449e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:12325:x1871938444169088:12345-192.168.203.31@tcp:35:umount.0 Request processed in 669us (940us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1785219911.213569:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 68 00000100:00100000:3.0:1785219911.216908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219911.217049:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444169344 00000100:00100000:0.0:1785219911.217062:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444169344 00000100:00100000:0.0:1785219911.217136:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:0.0:1785219911.217148:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:12325:x1871938444169344:12345-192.168.203.31@tcp:35:umount.0 00000100:00100000:0.0:1785219911.217993:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:12325:x1871938444169344:12345-192.168.203.31@tcp:35:umount.0 Request processed in 844us (1096us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1785219911.218005:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 69 00000100:00100000:1.0:1785219911.224479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219911.224569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219911.225737:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444169472 00000100:00100000:3.0:1785219911.225753:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444169472 00000100:00100000:3.0:1785219911.225857:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444169600 00000100:00100000:3.0:1785219911.225861:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444169600 00000100:00100000:3.0:1785219911.225896:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1785219911.225910:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+14:2361:x1871938444169472:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219911.225930:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219911.225959:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07e00/0x8b38d407a078c7bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f24a expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.225988:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219911.226185:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219911.226225:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444169728 00000100:00100000:0.0:1785219911.226230:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444169728 00000100:00100000:0.0:1785219911.226286:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00100000:0.0:1785219911.226294:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+5:2358:x1871938444169728:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:0.0:1785219911.226326:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078ca95 00000100:00080000:0.0:1785219911.226337:0:6586:0:(import.c:65:import_set_state_nolock()) ffff9cf381fb1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785219911.226413:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1785219911.226794:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+2:2358:x1871938444169728:12345-192.168.203.31@tcp:9:umount.0 Request processed in 500us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219911.226803:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 72 00000100:00080000:0.0:1785219911.226834:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1785219911.226948:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219911.226972:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1785219911.226980:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+13:2361:x1871938444169600:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785219911.226994:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219911.227017:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06c00/0x8b38d407a078c9a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f315 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219911.227032:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219911.228305:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:2361:x1871938444169472:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 2377us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219911.228320:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1785219911.229236:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2361:x1871938444169600:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 2249us (4659us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219911.229247:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:0.0:1785219911.231734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219911.232753:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444169856 00000100:00100000:2.0:1785219911.232773:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444169856 00000100:00100000:3.0:1785219911.232934:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1785219911.232969:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3488f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+11:2360:x1871938444169856:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785219911.233098:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219911.233127:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341477800/0x8b38d407a078c723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f212 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.233152:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785219911.233233:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3488f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2360:x1871938444169856:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 269us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219911.233242:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:3.0:1785219911.235354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219911.235558:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444170240 00000100:00100000:0.0:1785219911.235570:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444170240 00000100:00100000:0.0:1785219911.235658:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00080000:1.0:1785219911.235665:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219911.235684:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+7:2358:x1871938444170240:12345-192.168.203.31@tcp:9:umount.0 00000020:00000080:0.0:1785219911.235742:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078ccf6 00000020:00010000:0.0:1785219911.235750:0:6589:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9cf381973800: total 0 00000100:00080000:0.0:1785219911.235756:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9cf381974800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1785219911.235798:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9cf381973800: total 0 00000001:00000004:0.0:1785219911.235811:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:3.0:1785219911.235867:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9cf381973800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1785219911.235944:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df108a3d/0x8b38d407a078d099 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4ea expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.235992:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ebdc28/0x8b38d407a078d737 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6b8 expref: 5 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.236015:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9cf381973800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1785219911.236042:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219911.236046:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219911.236048:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219911.236392:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+2:2358:x1871938444170240:12345-192.168.203.31@tcp:9:umount.0 Request processed in 723us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219911.236399:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 73 00000100:00100000:1.0:1785219911.250654:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219911.250878:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444171264 00000100:00100000:2.0:1785219911.250891:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444171264 00000100:00100000:2.0:1785219911.250954:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 240 00000100:00100000:2.0:1785219911.250964:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+23:2358:x1871938444171264:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:2.0:1785219911.251009:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c731 00000020:00010000:2.0:1785219911.251022:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9cf244b36800: total 0 00000100:00080000:2.0:1785219911.251027:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9cf348632000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785219911.251064:0:5794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1785219911.251572:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c48a627-3c4f-49d5-b2ec-dae54c1457bb+22:2358:x1871938444171264:12345-192.168.203.31@tcp:39:umount.0 Request processed in 606us (931us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1785219911.251582:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 240 00000020:00010000:3.0:1785219911.251857:0:11513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9cf244b36800: total 0 00010000:00010000:3.0:1785219911.251924:0:11513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9cf244b36800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1785219911.251967:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219911.251972:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1785219911.251982:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf341477a00/0x8b38d407a078ca6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f33f expref: 21 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252027:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219911.252031:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219911.252036:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0a00/0x8b38d407a078d618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f66b expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252050:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219911.252053:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219911.252057:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28600/0x8b38d407a078d714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6aa expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252069:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219911.252072:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1785219911.252075:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0000/0x8b38d407a078d117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f50d expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252088:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219911.252090:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785219911.252094:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078cf7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f49d expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252106:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788e00) 00010000:00010000:3.0:1785219911.252109:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785219911.252112:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07200/0x8b38d407a078ca17 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f32a expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252133:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:3.0:1785219911.252136:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219911.252147:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078d0fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f506 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252161:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219911.252163:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785219911.252167:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf354f80a00/0x8b38d407a078d05a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4d5 expref: 14 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252191:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219911.252194:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1785219911.252198:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078d6ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6a3 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252211:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf356788f00) 00010000:00010000:3.0:1785219911.252214:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1785219911.252217:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28a00/0x8b38d407a078d722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6b1 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252233:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf356788a00) 00010000:00010000:3.0:1785219911.252236:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785219911.252240:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06600/0x8b38d407a078cd58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f411 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252319:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf356788700) 00010000:00010000:3.0:1785219911.252322:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785219911.252327:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06e00/0x8b38d407a078c9fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f323 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252342:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785219911.252352:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1785219911.252358:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078d084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f4e3 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252406:0:11513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf342843600) 00010000:00010000:3.0:1785219911.252409:0:11513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785219911.252413:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf348a28800/0x8b38d407a078d3f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f5df expref: 8 pid: 8055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219911.252429:0:11513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9cf244b36800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1785219911.252447:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219911.252449:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219911.252451:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219912.043960:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785219912.161077:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1785219912.161120:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000001:00080000:0.0:1785219912.161128:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1785219912.161134:0:5816:0:(genops.c:906:class_export_put()) final put ffff9cf244b36800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:0.0:1785219912.161165:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf244b36800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb for lustre-MDT0000 00000020:00000080:0.0:1785219912.161258:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf348632000 for lustre-MDT0000 00000001:00100000:1.0:1785219912.163821:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:1.0:1785219912.163833:0:6614:0:(genops.c:906:class_export_put()) final put ffff9cf381973800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:2.0:1785219912.163921:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf381973800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb for lustre-OST0000 00000020:00000080:2.0:1785219912.164002:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf381974800 for lustre-OST0000 00000100:00100000:2.0:1785219912.619700:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465120640:0@lo:400:kworker.0 00000100:00100000:2.0:1785219912.619803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219912.619954:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465120768:0@lo:400:kworker.0 00000100:00100000:3.0:1785219912.619996:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219912.621411:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120640 00000100:00100000:0.0:1785219912.621426:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120640 00000100:00100000:0.0:1785219912.621507:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1785219912.621518:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465120640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219912.621611:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120768 00000100:00100000:3.0:1785219912.621617:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120768 00000100:00100000:3.0:1785219912.621677:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1785219912.621684:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465120768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219912.621739:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465120768:12345-0@lo:400:kworker.0 Request processed in 55us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219912.621747:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1785219912.621813:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465120768:0@lo:400:kworker.0 00000100:00100000:1.0:1785219912.623568:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465121024:0@lo:400:kworker.0 00000100:00100000:1.0:1785219912.623650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219912.623705:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785219912.623712:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465120896:0@lo:400:kworker.0 00000100:00100000:1.0:1785219912.623741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219912.623785:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121024 00000100:00100000:1.0:1785219912.623793:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121024 00000100:00100000:3.0:1785219912.623807:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465121280:0@lo:400:kworker.0 00000100:00100000:3.0:1785219912.623844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219912.627083:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3308:x1871938465120640:12345-0@lo:400:kworker.0 Request processed in 5550us (7264us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219912.627088:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785219912.627105:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1785219912.627190:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465121152:0@lo:400:kworker.0 00000100:00100000:0.0:1785219912.627229:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465120896 00000100:00100000:0.0:1785219912.627240:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465120896 00000100:00100000:0.0:1785219912.627295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1785219912.627306:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465120896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219912.627340:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219912.627398:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121152 00000100:00100000:3.0:1785219912.627402:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121152 00000100:00100000:0.0:1785219912.627407:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465120896:12345-0@lo:400:kworker.0 Request processed in 101us (3663us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219912.627426:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1785219912.627441:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1785219912.627450:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465121152:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785219912.627462:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785219912.627468:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219912.627493:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465121152:12345-0@lo:400:kworker.0 Request processed in 44us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219912.627501:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1785219912.627552:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465121152:0@lo:400:kworker.0 00000100:00100000:2.0:1785219912.629442:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465120640:0@lo:400:kworker.0 00000100:00100000:2.0:1785219912.629555:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465120896:0@lo:400:kworker.0 00000100:00100000:1.0:1785219912.631135:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121280 00000100:00100000:1.0:1785219912.631154:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121280 00000100:00100000:1.0:1785219912.631593:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1785219912.631618:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785219912.631646:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1785219912.631655:0:6589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1785219912.631660:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465121280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219912.631679:0:6589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1785219912.631865:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465121280:12345-0@lo:400:kworker.0 Request processed in 208us (8019us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219912.631960:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465121280:0@lo:400:kworker.0 00000100:00100000:3.0:1785219912.632028:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1785219912.632069:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465121024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219912.632129:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465121024:12345-0@lo:400:kworker.0 Request processed in 526us (8479us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219912.632137:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1785219912.633211:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465121024:0@lo:400:kworker.0 00000100:00100000:1.0:1785219912.720361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219912.720464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219912.720475:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444171392 00000100:00100000:3.0:1785219912.720491:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444171392 00000100:00100000:0.0:1785219912.720591:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444171520 00000100:00100000:0.0:1785219912.720596:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444171520 00000100:00100000:0.0:1785219912.720696:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:0.0:1785219912.720708:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38175a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2359:x1871938444171520:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1785219912.720709:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219912.720801:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:3.0:1785219912.720812:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2359:x1871938444171392:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219912.720816:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38175a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2359:x1871938444171520:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 108us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219912.720827:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 162 00000100:00100000:3.0:1785219912.721297:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2359:x1871938444171392:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 486us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219912.721306:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 300 00000100:00100000:1.0:1785219912.937218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219912.937270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219912.937319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219912.937408:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444171648 00000100:00100000:2.0:1785219912.937422:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444171648 00000100:00100000:2.0:1785219912.937537:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444171904 00000100:00100000:2.0:1785219912.937541:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444171904 00000100:00100000:1.0:1785219912.937605:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444171776 00000100:00100000:1.0:1785219912.937609:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444171776 00000100:00100000:1.0:1785219912.937640:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1785219912.937650:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:2359:x1871938444171648:12345-192.168.203.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1785219912.937654:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:0.0:1785219912.937678:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1078a347-e541-4ca3-9e62-f1dcd49a05cf+12:2359:x1871938444171904:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219912.937681:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219912.937690:0:6603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219912.937713:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078c803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f25f expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219912.937714:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06400/0x8b38d407a078c9a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f30e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219912.937747:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785219912.937747:0:6603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219912.937949:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+10:2359:x1871938444171648:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 299us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219912.937957:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1785219912.937978:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:1.0:1785219912.937983:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+9:2359:x1871938444171776:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785219912.937992:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785219912.938001:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cc000/0x8b38d407a078c80a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f289 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219912.938020:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219912.938037:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1078a347-e541-4ca3-9e62-f1dcd49a05cf+8:2359:x1871938444171776:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 54us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219912.938043:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1785219912.941812:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1078a347-e541-4ca3-9e62-f1dcd49a05cf+7:2359:x1871938444171904:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 4118us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219912.941833:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1785219912.945557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219912.945707:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444172160 00000100:00100000:3.0:1785219912.945721:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444172160 00000100:00100000:3.0:1785219912.945868:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 241 00000100:00100000:3.0:1785219912.945883:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36cef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+6:2358:x1871938444172160:12345-192.168.203.31@tcp:39:umount.0 00000020:00000080:3.0:1785219912.945969:0:5795:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c818 00000020:00010000:3.0:1785219912.945980:0:5795:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9cf36cda1000: total 0 00000100:00080000:3.0:1785219912.945985:0:5795:0:(import.c:65:import_set_state_nolock()) ffff9cf36cda6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785219912.946027:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1785219912.947832:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36cef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:440d444c-61d3-4ab8-9ade-966ffdd2cbcf+5:2358:x1871938444172160:12345-192.168.203.31@tcp:39:umount.0 Request processed in 1940us (2277us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1785219912.947848:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 241 00000020:00010000:2.0:1785219912.948504:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9cf36cda1000: total 0 00010000:00010000:2.0:1785219912.948512:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219912.948578:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9cf36cda1000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1785219912.948622:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf342843800) 00010000:00010000:2.0:1785219912.948626:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785219912.948636:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078d745 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6bf expref: 4 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219912.948671:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9cf36cda1000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1785219912.948681:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219912.948683:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219912.948684:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219912.974231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219912.974477:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444172416 00000100:00100000:0.0:1785219912.974494:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444172416 00000100:00100000:0.0:1785219912.974566:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 301 00000100:00100000:0.0:1785219912.974579:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+7:2358:x1871938444172416:12345-192.168.203.31@tcp:251:umount.0 00000020:00000080:0.0:1785219912.974637:0:5788:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c70e 00000020:00010000:0.0:1785219912.974648:0:5788:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9cf244b37800: total 0 00000100:00080000:0.0:1785219912.974681:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9cf244b33800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1785219912.974783:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1078a347-e541-4ca3-9e62-f1dcd49a05cf+3:2358:x1871938444172416:12345-192.168.203.31@tcp:251:umount.0 Request processed in 206us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219912.974792:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 301 00000020:00010000:3.0:1785219912.976029:0:11513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9cf244b37800: total 0 00010000:00010000:3.0:1785219912.976127:0:11513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9cf244b37800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1785219912.976179:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341476c00/0x8b38d407a078c7c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f251 expref: 2 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219912.976203:0:11513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9cf244b37800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1785219912.976215:0:11513:0:(genops.c:906:class_export_put()) final put ffff9cf244b37800/1078a347-e541-4ca3-9e62-f1dcd49a05cf 00010000:00010000:3.0:1785219912.976242:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219912.976244:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219912.976246:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785219912.976293:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf244b37800/1078a347-e541-4ca3-9e62-f1dcd49a05cf for MGS 00000020:00000080:0.0:1785219912.976355:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf244b33800 for MGS 00010000:00010000:0.0:1785219913.071856:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219913.131787:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465121408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785219913.131899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219913.132218:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121408 00000100:00100000:1.0:1785219913.132229:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121408 00000100:00100000:1.0:1785219913.132292:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1785219913.132302:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465121408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785219913.132351:0:6590:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785219913.132456:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465121408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219913.132464:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785219913.132611:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465121408:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1785219913.261738:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785219913.261750:0:11530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785219913.262195:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1785219913.262204:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1785219914.092759:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785219914.199149:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:3.0:1785219914.199162:0:7492:0:(genops.c:906:class_export_put()) final put ffff9cf381fb3800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb 00000020:00000080:0.0:1785219914.199197:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf381fb3800/3c48a627-3c4f-49d5-b2ec-dae54c1457bb for lustre-OST0001 00000020:00000080:0.0:1785219914.199277:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf381fb1800 for lustre-OST0001 00000020:01000004:1.0:1785219914.833438:0:12866:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1785219914.865746:0:12866:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1785219914.865817:0:12866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.865836:0:12866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.865845:0:12866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.865851:0:12866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.865916:0:12866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785219914.865924:0:12866:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1785219914.865956:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219914.865962:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1785219914.865969:0:12866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1785219914.866014:0:12866:0:(import.c:65:import_set_state_nolock()) ffff9cf356474800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1785219914.866081:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465121536:0@lo:39:umount.0 00000100:00100000:0.0:1785219914.866174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219914.866269:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121536 00000100:00100000:0.0:1785219914.866279:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121536 00000100:00100000:0.0:1785219914.866334:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1785219914.866343:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871938465121536:12345-0@lo:39:umount.0 00000020:00000080:0.0:1785219914.866400:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c51d 00000100:00080000:0.0:1785219914.866410:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9cf36cdc5800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1785219914.866820:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219914.866831:0:11513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.866841:0:11513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07800 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219914.866846:0:11513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.866856:0:11513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219914.866864:0:11513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219914.866870:0:11513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785219914.866873:0:11513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1785219914.866886:0:11513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1785219914.866918:0:11513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.866926:0:11513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785219914.866980:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf36cef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465121664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219914.867032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219914.867155:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121664 00000100:00100000:3.0:1785219914.867162:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121664 00000100:00100000:3.0:1785219914.867203:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785219914.867211:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465121664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785219914.867224:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219914.867243:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078c79a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c793 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219914.867270:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785219914.867336:0:11513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.867344:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f07800/0x8b38d407a078c793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c79a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.867357:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219914.867359:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219914.867361:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219914.867510:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1871938465121536:12345-0@lo:39:umount.0 Request processed in 1167us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219914.867520:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1785219914.867537:0:5794:0:(genops.c:906:class_export_put()) final put ffff9cf36cdc0000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1785219914.867587:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf356474800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1785219914.867595:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465121536:0@lo:39:umount.0 00000100:00080000:0.0:1785219914.867627:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219914.867631:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1785219914.867636:0:12866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1785219914.868776:0:12866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868798:0:12866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868805:0:12866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868814:0:12866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868858:0:12866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219914.868866:0:12866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868872:0:12866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868878:0:12866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868884:0:12866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868897:0:12866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1785219914.868904:0:12866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868911:0:12866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868917:0:12866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868922:0:12866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868929:0:12866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1785219914.868934:0:12866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868946:0:12866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868952:0:12866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868959:0:12866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.868966:0:12866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1785219914.868969:0:12866:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1785219914.869110:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1785219914.869119:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869128:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341477e00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219914.869132:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869142:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219914.869150:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219914.869156:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785219914.869159:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1785219914.869162:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1785219914.869203:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869215:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219914.869240:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869247:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341477e00/0x8b38d407a078c7a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c7a8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869264:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785219914.869267:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869274:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030800 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219914.869277:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869284:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219914.869290:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219914.869295:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1785219914.869297:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1785219914.869299:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1785219914.869313:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869320:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219914.869325:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869341:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf340030800/0x8b38d407a078c6c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c6cf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869355:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785219914.869358:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869383:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29a00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219914.869386:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869392:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219914.869397:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219914.869402:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1785219914.869404:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1785219914.869406:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1785219914.869420:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.869426:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1785219914.869569:0:12866:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1785219914.869574:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1785219914.869580:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219914.869586:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1785219914.869595:0:12866:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf2462f5000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785219914.869602:0:12866:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf36f4a8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785219914.869610:0:12866:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9cf36cda1000 440d444c-61d3-4ab8-9ade-966ffdd2cbcf 192.168.203.31@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785219914.869615:0:12866:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9cf36cf1cd40) has exports, disconnecting them 00000020:00080000:0.0:1785219914.869619:0:12866:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf2462f5000), last request at 1785219912 00000020:00000080:0.0:1785219914.869627:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c690 00000100:00080000:0.0:1785219914.869655:0:12866:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1785219914.869710:0:12866:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf2462f5000): rc 0 00000020:00000080:0.0:1785219914.869712:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf2462f5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1785219914.869719:0:12866:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf36f4a8800), last request at 1785219912 00000020:00000080:0.0:1785219914.869722:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c5b7 00000100:00080000:0.0:1785219914.869727:0:12866:0:(import.c:65:import_set_state_nolock()) ffff9cf36f4ae000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1785219914.869741:0:12866:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf36f4a8800): rc 0 00000020:00000080:0.0:1785219914.869743:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36f4a8800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1785219914.869755:0:12866:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbcd6c19c3ae0 00000100:00080000:0.0:1785219914.869777:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1785219914.869781:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1785219914.869795:0:12866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1785219914.869862:0:12866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1785219914.869876:0:12866:0:(import.c:65:import_set_state_nolock()) ffff9cf36f4ad800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1785219914.869891:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1785219914.869893:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1785219914.869901:0:12866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1785219914.869993:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465122176:0@lo:9:umount.0 00000100:00100000:0.0:1785219914.870068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785219914.870119:0:12866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1785219914.870131:0:12866:0:(import.c:65:import_set_state_nolock()) ffff9cf348632800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1785219914.870148:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465122304:0@lo:9:umount.0 00000100:00100000:0.0:1785219914.870176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1785219914.870232:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9cf36cf1cd40) has no exports 00000100:00100000:3.0:1785219914.870407:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6828c272-120a-44fd-b7c4-fcf074b0473f+18:3307:x1871938465121664:12345-0@lo:103:ldlm_bl.0 Request processed in 3193us (3371us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219914.870419:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785219914.871023:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf36cef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465121664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219914.871048:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785219914.871056:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465122048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219914.871095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785219914.871144:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219914.871154:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.871164:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476e00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219914.871169:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.871178:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219914.871187:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219914.871193:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1785219914.871196:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1785219914.871199:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1785219914.871224:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.871230:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219914.871244:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.871264:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341476e00/0x8b38d407a078c47c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c483 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.871283:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219914.871285:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219914.871287:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219914.871300:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465121792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219914.871327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219914.871348:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219914.871354:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465121920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219914.871395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219914.871432:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122176 00000100:00100000:2.0:1785219914.871440:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122176 00000100:00100000:2.0:1785219914.871495:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122304 00000100:00100000:2.0:1785219914.871499:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122304 00000100:00100000:2.0:1785219914.871528:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785219914.871537:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871938465122176:12345-0@lo:9:umount.0 00000020:00000080:2.0:1785219914.871568:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c604 00000100:00080000:2.0:1785219914.871576:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9cf381610800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785219914.871611:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1785219914.872018:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1871938465122176:12345-0@lo:9:umount.0 Request processed in 480us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219914.872025:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785219914.872042:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785219914.872049:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871938465122304:12345-0@lo:9:umount.0 00000020:00000080:2.0:1785219914.872063:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c6f9 00000100:00080000:2.0:1785219914.872076:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9cf2461ed800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785219914.872094:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1785219914.872290:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1871938465122304:12345-0@lo:9:umount.0 Request processed in 241us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219914.872296:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785219914.872327:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122048 00000100:00100000:2.0:1785219914.872332:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122048 00000100:00100000:2.0:1785219914.872389:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121792 00000100:00100000:2.0:1785219914.872392:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121792 00000100:00100000:2.0:1785219914.872406:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465121920 00000100:00100000:2.0:1785219914.872410:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465121920 00000100:00100000:2.0:1785219914.872425:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785219914.872432:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+20:3307:x1871938465122048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219914.872443:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219914.872462:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81e00/0x8b38d407a078c9d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c9ca expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.872478:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219914.872505:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+19:3307:x1871938465122048:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219914.872511:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785219914.872524:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785219914.872530:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381774380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+18:3308:x1871938465121792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219914.872537:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219914.872546:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81a00/0x8b38d407a078c7a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c7a1 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.872554:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219914.872582:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381774380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+17:3308:x1871938465121792:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219914.872594:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785219914.872606:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785219914.872611:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+16:3308:x1871938465121920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219914.872618:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219914.872627:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf341476200/0x8b38d407a078c6cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c6c8 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219914.872641:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219914.872676:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:3308:x1871938465121920:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219914.872682:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1785219914.872703:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219914.872709:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785219914.872726:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219914.872763:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465121920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219914.872772:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465121792:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1785219914.872811:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf348632800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1785219914.872819:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1785219914.872821:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785219914.872824:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3488f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465122304:0@lo:9:umount.0 00000100:00080000:2.0:1785219914.872836:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf36f4ad800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1785219914.872840:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1785219914.872842:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785219914.872844:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf37e465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465122176:0@lo:9:umount.0 00000100:00100000:2.0:1785219914.872873:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465122432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219914.872925:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.872935:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf348a29a00/0x8b38d407a078c9ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219914.872960:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219914.872962:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219914.872963:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219914.872991:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219914.873064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219914.873156:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465122048:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1785219914.873185:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cdc0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1785219914.873279:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf2462f5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1785219914.873316:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36f4a8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1785219914.873349:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf36cdc5800 for lustre-MDT0000 00000020:00000080:2.0:1785219914.873355:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf2462f0000 for lustre-MDT0000 00000020:00000080:2.0:1785219914.873359:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf36f4ae000 for lustre-MDT0000 00000100:00100000:0.0:1785219914.873534:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122432 00000100:00100000:0.0:1785219914.873541:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122432 00000100:00100000:0.0:1785219914.873610:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785219914.873618:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf37e465500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+15:3307:x1871938465122432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785219914.873629:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219914.873642:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06800/0x8b38d407a078c483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c47c expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219914.873671:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219914.873723:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf37e465500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6828c272-120a-44fd-b7c4-fcf074b0473f+14:3307:x1871938465122432:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219914.873737:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785219914.873808:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465122432:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1785219914.881732:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9cf36cf1cd40) has no exports 00000020:00000080:0.0:1785219914.944494:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c4d7 00000020:00000080:0.0:1785219914.944509:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf381941000/lustre-QMT0000_UUID 00000020:01000000:0.0:1785219914.944572:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1785219914.944636:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf381941000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1785219914.944673:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785219914.944683:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785219914.944688:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9cf36cf1b380) has no exports 00000020:00000080:1.0:1785219914.948964:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c4d0 00000020:00000080:1.0:1785219914.948981:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf343664000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1785219914.949106:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785219914.949118:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1785219914.949121:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf343661000/lustre-QMT0000_UUID 00000020:00000080:1.0:1785219914.949125:0:12866:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf343661000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1785219914.949131:0:12866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1785219914.949593:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf343664000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1785219915.121636:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219916.139861:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219917.163688:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785219917.286838:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00000001:00080000:0.0:1785219917.286862:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1785219917.286868:0:5816:0:(genops.c:906:class_export_put()) final put ffff9cf36cda1000/440d444c-61d3-4ab8-9ade-966ffdd2cbcf 00000020:00000080:3.0:1785219917.287805:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cda1000/440d444c-61d3-4ab8-9ade-966ffdd2cbcf for lustre-MDT0000 00000020:00000080:3.0:1785219917.287883:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf36cda6800 for lustre-MDT0000 00000001:00100000:1.0:1785219917.303132:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1785219917.303145:0:6614:0:(genops.c:906:class_export_put()) final put ffff9cf381610000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785219917.303320:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf381610000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1785219917.303410:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf381610800 for lustre-OST0000 00000100:00100000:1.0:1785219917.740093:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465122816:0@lo:400:kworker.0 00000100:00100000:1.0:1785219917.740201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219917.740347:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122816 00000100:00100000:2.0:1785219917.740358:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122816 00000100:00100000:2.0:1785219917.740440:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1785219917.740449:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1871938465122816:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1785219917.740460:0:8055:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1785219917.740510:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1871938465122816:12345-0@lo:400:kworker.0 Request processed in 60us (308us total) trans 0 rc -107/-107 00000100:00100000:2.0:1785219917.740517:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1785219917.740650:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1785219917.740665:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9cf34874d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1785219917.740669:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1785219917.740786:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465122688:0@lo:400:kworker.0 00000100:00100000:3.0:1785219917.740830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219917.740866:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785219917.740874:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465122560:0@lo:400:kworker.0 00000100:00100000:3.0:1785219917.740912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219917.740956:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122560 00000100:00100000:3.0:1785219917.740961:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122560 00000100:00100000:3.0:1785219917.741000:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1785219917.741008:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:3309:x1871938465122560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219917.741064:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3489f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6828c272-120a-44fd-b7c4-fcf074b0473f+14:3309:x1871938465122560:12345-0@lo:400:kworker.0 Request processed in 56us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219917.741071:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1785219917.741115:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:3309:1871938465122560:0@lo:400:kworker.0 00000100:00100000:3.0:1785219917.741170:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122688 00000100:00100000:3.0:1785219917.741174:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122688 00000100:00100000:3.0:1785219917.741213:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1785219917.741217:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1871938465122688:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1785219917.741223:0:5793:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1785219917.741253:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1871938465122688:12345-0@lo:400:kworker.0 Request processed in 35us (424us total) trans 0 rc -107/-107 00000100:00100000:3.0:1785219917.741260:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1785219917.741281:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1785219917.741284:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9cf37e451000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1785219917.741287:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1785219917.741293:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9cf37e451000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785219917.741297:0:3309:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:3.0:1785219917.741305:0:3309:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cf37e451000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1785219917.741335:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf246f78a80 x1871938465122944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785219917.741357:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465122688:0@lo:400:kworker.0 00000100:00100000:3.0:1785219917.741404:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465122944:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1785219917.741433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219917.742778:0:8055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465122944 00000100:00100000:0.0:1785219917.742792:0:8055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465122944 00000100:00100000:0.0:1785219917.742853:0:8055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1785219917.742860:0:8055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1871938465122944:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1785219917.742882:0:8055:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1785219917.749944:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9cf34874d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785219917.750024:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 228 00000100:00080000:1.0:1785219917.750038:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cf34874d000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1785219917.750118:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf3506c4e00 x1871938465123072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785219917.750167:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465122816:0@lo:400:kworker.0 00000100:00100000:3.0:1785219917.750550:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465123072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1785219917.750659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219917.750852:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465123072 00000100:00100000:1.0:1785219917.750864:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465123072 00000100:00100000:1.0:1785219917.750926:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1785219917.750935:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1871938465123072:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1785219917.750966:0:5793:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1785219917.751023:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1871938465123072:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 87us (364us total) trans 0 rc -19/-19 00000100:00100000:1.0:1785219917.751032:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1785219917.751287:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf34874d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785219917.751294:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1785219917.751298:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465123072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1785219917.778094:0:8055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1871938465122944:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35223us (36650us total) trans 0 rc -19/-19 00000100:00100000:0.0:1785219917.778113:0:8055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1785219917.780587:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf37e451000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785219917.780605:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1785219917.780648:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465122944:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1785219918.187584:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219919.212061:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785219919.338749:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785219919.338764:0:7492:0:(genops.c:906:class_export_put()) final put ffff9cf2461ec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1785219919.338966:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf2461ec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1785219919.339037:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf2461ed800 for lustre-OST0001 00010000:00010000:1.0:1785219920.235708:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1785219921.003896:0:12866:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf381e8bc00 - data ffff9cf36fe79948/ffff9cf2459f6c00 00000020:01000000:1.0:1785219921.004242:0:12866:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf3817133c0 - data ffff9cf374bc6510/ffff9cf377bf6800 00000001:00000004:1.0:1785219921.021200:0:12866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1785219921.111092:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1785219921.111103:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1785219921.111130:0:12866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1785219921.111133:0:12866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1785219921.111598:0:6629:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1785219921.111614:0:6629:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1785219921.111627:0:6629:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1785219921.117864:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1785219921.117875:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1785219921.118280:0:12866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1785219921.118284:0:12866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1785219921.120904:0:7923:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1785219921.120924:0:7923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1785219921.120940:0:7923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1785219921.191689:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c49f 00000020:00000080:0.0:1785219921.191706:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36cf25800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1785219921.193894:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c4b4 00000020:00000080:0.0:1785219921.193909:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36cf26000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785219921.194041:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cf25800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1785219921.194140:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1785219921.194151:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219921.194162:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785219921.194166:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9cf36cf18000) has no exports 00000004:01000000:0.0:1785219921.194405:0:12866:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1785219921.194418:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c6f2 00000020:00000080:0.0:1785219921.194422:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf34874e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785219921.194693:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cf26000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1785219921.194758:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1785219921.194764:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219921.194787:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1785219921.194790:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9cf371a74d40) has no exports 00000020:00000080:0.0:1785219921.194799:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c6eb 00000020:00000080:0.0:1785219921.194804:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf348637000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1785219921.194826:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf34874e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1785219921.195303:0:12866:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1785219921.195308:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1785219921.195314:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1785219921.195323:0:12866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1785219921.195326:0:12866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1785219921.195662:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf348637000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1785219921.195783:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219921.195795:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785219921.195803:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c5fd 00000020:00000080:0.0:1785219921.195810:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36f4ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785219921.195828:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf348632800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1785219921.195836:0:36:0:(genops.c:906:class_export_put()) final put ffff9cf2462f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785219921.195839:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf2462f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1785219921.195845:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1785219921.196052:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1785219921.196057:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219921.196062:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1785219921.196067:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9cf371a73380) has no exports 00000020:00000080:0.0:1785219921.196074:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c5f6 00000020:00000080:0.0:1785219921.196079:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36f4aa800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1785219921.196100:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36f4ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1785219921.196678:0:12866:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1785219921.196682:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1785219921.196687:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1785219921.196692:0:12866:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1785219921.196695:0:12866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1785219921.196999:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36f4aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1785219921.197099:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219921.197109:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785219921.197147:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219921.197152:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785219921.197155:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf342f98000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785219921.197158:0:12866:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf342f98000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1785219921.197164:0:12866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785219921.197341:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c4bb 00000020:00000080:0.0:1785219921.197360:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36cf20800/lustre-MDD0000_UUID 00000020:00000080:3.0:1785219921.197645:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf36f4ad800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1785219921.197653:0:36:0:(genops.c:906:class_export_put()) final put ffff9cf36f4ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785219921.197655:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36f4ab000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1785219921.197662:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1785219921.197800:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1785219921.197805:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219921.197811:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785219921.197815:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9cf36cf199c0) has no exports 00000020:00000080:0.0:1785219921.197843:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219921.197847:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1785219921.197851:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c4c2 00000020:00000080:0.0:1785219921.197855:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36cf20000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1785219921.197869:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cf20800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1785219921.197873:0:36:0:(genops.c:906:class_export_put()) final put ffff9cf36cf24800/lustre-MDD0000_UUID 00000020:00000080:3.0:1785219921.197881:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cf24800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1785219921.197886:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1785219921.198163:0:12866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf3503a5000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1785219921.198168:0:12866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf3503a5000 3 00000020:01000004:0.0:1785219921.198172:0:12866:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf3503a5000 from lustre-MDT0000 00000020:00000080:0.0:1785219921.198196:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219921.198200:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1785219921.198203:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf36cf22800/lustre-MDT0000_UUID 00000020:00000080:0.0:1785219921.198206:0:12866:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cf22800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1785219921.198214:0:12866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1785219921.198245:0:12866:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1785219921.198249:0:12866:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1785219921.198252:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1785219921.198254:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219921.198257:0:12866:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1785219921.198265:0:12866:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9cf3486ed800 6828c272-120a-44fd-b7c4-fcf074b0473f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785219921.198271:0:12866:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9cf34866cd40) has exports, disconnecting them 00000020:00080000:0.0:1785219921.198276:0:12866:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cf3486ed800), last request at 1785219703 00000020:00000080:0.0:1785219921.198292:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c460 00000020:00010000:0.0:1785219921.198297:0:12866:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9cf3486ed800: total 1 00000100:00080000:0.0:1785219921.198302:0:12866:0:(import.c:65:import_set_state_nolock()) ffff9cf3486ec000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1785219921.198324:0:12866:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf3486ed800): rc 0 00000020:00080000:0.0:1785219921.198329:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9cf34866cd40) has no exports 00000100:00100000:0.0:1785219921.198416:0:5785:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cf350aa1c00:5785] 0 exiting: rc = 1 00000020:00010000:1.0:1785219921.198621:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9cf3486ed800: total 1 00010000:00010000:1.0:1785219921.198660:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9cf3486ed800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1785219921.198693:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f06200/0x8b38d407a078c77e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c777 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198712:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81000/0x8b38d407a078c78c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c785 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198732:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cc600/0x8b38d407a078c9b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c9ae expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198744:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f80200/0x8b38d407a078c56a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c563 expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198760:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cce00/0x8b38d407a078c7b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c7af expref: 5 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198770:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf354f81c00/0x8b38d407a078c9c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c9bc expref: 4 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198783:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cca00/0x8b38d407a078c770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c769 expref: 3 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198795:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07000/0x8b38d407a078c762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8b38d407a078c75b expref: 2 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219921.198806:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9cf3486ed800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1785219921.198816:0:5781:0:(genops.c:906:class_export_put()) final put ffff9cf3486ed800/6828c272-120a-44fd-b7c4-fcf074b0473f 00000100:00100000:0.0:1785219921.198939:0:5788:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cf3494a1000:5788] 2 exiting: rc = 0 00000020:00000080:3.0:1785219921.199133:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf36cf20000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1785219921.199190:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219921.199193:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219921.199195:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1785219921.199214:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf3486ed800/6828c272-120a-44fd-b7c4-fcf074b0473f for MGS 00000020:00000080:3.0:1785219921.199305:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf3486ec000 for MGS 00000100:00100000:0.0:1785219921.199640:0:5787:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cf3494a1400:5787] 1 exiting: rc = 0 00000100:00100000:1.0:1785219921.200746:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.200761:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.200767:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.200772:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.200778:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.200788:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.200794:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.200814:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201109:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201116:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201124:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201131:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201137:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201143:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201150:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201156:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201162:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201168:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201177:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201183:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201190:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201195:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201201:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201208:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201214:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201220:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201226:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201231:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201237:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201242:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201248:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201254:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201260:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201266:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201271:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201276:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201281:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201287:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201292:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201297:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201304:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201309:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201322:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201327:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201333:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201338:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201344:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201350:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201356:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201791:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201803:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201809:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201815:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201822:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201827:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201833:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201839:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201845:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201851:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201858:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201864:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201870:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201876:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.201881:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1785219921.202753:0:12866:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1785219921.202759:0:12866:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1785219921.204711:0:12866:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf381a488a0 - data ffff9cf37a062360/ffff9cf2458e8c00 00000020:01000000:1.0:1785219921.204869:0:12866:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf351fbb0c0 - data ffff9cf34ae546c0/ffff9cf351905800 00000020:00000080:1.0:1785219921.205687:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c444 00000020:00000080:1.0:1785219921.205697:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf351c17000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1785219921.205721:0:12866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf3503a5000 from MGS, refs=2 00000020:01000004:1.0:1785219921.205726:0:12866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf3503a5000 2 00000020:01000004:1.0:1785219921.205730:0:12866:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf3503a5000 from MGS 00000020:00000080:1.0:1785219921.205758:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785219921.205766:0:12866:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1785219921.205769:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf3503a1800/MGS 00000020:00000080:1.0:1785219921.205772:0:12866:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf3503a1800/MGS for MGS 00000020:01000000:1.0:1785219921.205796:0:12866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1785219921.205874:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1785219921.205878:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785219921.205885:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1785219921.205893:0:12866:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cf3717ec800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1785219921.205900:0:12866:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9cf349c54d40) has exports, disconnecting them 00000020:00080000:1.0:1785219921.205905:0:12866:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cf3717ec800), last request at 1785219704 00000020:00000080:1.0:1785219921.205910:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c50f 00000020:00080000:1.0:1785219921.205920:0:12866:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf3717ec800): rc 0 00000020:00000080:1.0:1785219921.205925:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf3717ec800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1785219921.206576:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf351c17000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785219921.206589:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf3717ec800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1785219921.215628:0:12866:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1785219921.215643:0:12866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219921.215648:0:12866:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1785219921.215659:0:12866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1785219921.215849:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219921.215861:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1785219921.215870:0:12866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf3503a5000 1 00000020:00000080:0.0:1785219921.215880:0:12866:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c436 00000020:00000080:3.0:1785219921.215911:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf356474800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1785219921.215921:0:36:0:(genops.c:906:class_export_put()) final put ffff9cf381944800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1785219921.215925:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf381944800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1785219921.215944:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1785219921.216111:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf3503a6000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1785219921.216143:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1785219921.216148:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219921.216154:0:12866:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785219921.216158:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9cf349c50000) has no exports 00000020:00000080:3.0:1785219921.217075:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf3503a6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1785219921.269894:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785219921.269913:0:12866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1785219921.269921:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf342f9a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1785219921.269926:0:12866:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf342f9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1785219921.270442:0:12866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1785219921.270707:0:12866:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf342f9e800 00000020:01000000:1.0:1785219921.270735:0:12866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1785219921.270740:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785219921.270746:0:12866:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785219921.270751:0:12866:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9cf34806b380) has no exports 00000100:00100000:0.0:1785219921.273453:0:5795:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9cf371b7f600:5795] 2 exiting: rc = 0 00000100:00100000:0.0:1785219921.273761:0:8055:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cf3503ed000:8055] 3 exiting: rc = 0 00000100:00100000:1.0:1785219921.275735:0:5793:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9cf3507da200:5793] 0 exiting: rc = 1 00000100:00100000:3.0:1785219921.276011:0:5794:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9cf371b7ea00:5794] 1 exiting: rc = 0 00000100:00100000:1.0:1785219921.276235:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276244:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276251:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276257:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276263:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276269:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276276:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276302:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276312:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276319:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276326:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276351:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276357:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276623:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276632:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276638:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276644:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276650:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276656:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276664:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276670:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276676:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276682:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276688:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276694:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276700:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276707:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276714:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276721:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276727:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276734:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276740:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276746:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276752:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276758:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276764:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276769:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276775:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276781:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276787:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276794:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276802:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276808:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276815:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276821:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276827:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276846:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276851:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276859:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276864:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276873:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276879:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276885:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276892:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276899:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276905:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276911:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276917:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.276924:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.277140:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.277151:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.277161:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.277168:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.277175:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219921.283065:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cf371b7f400:5796] 0 exiting: rc = 1 00000100:00100000:3.0:1785219921.283290:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9cf371b7ee00:5797] 1 exiting: rc = 0 00000100:00100000:1.0:1785219921.283667:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283680:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283686:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283692:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283699:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283706:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283712:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283718:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283726:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283732:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283739:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283746:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283754:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283759:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283765:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283771:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283777:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283798:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283804:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283810:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283816:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283821:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283827:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283832:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283838:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283844:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283850:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283855:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283860:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283865:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283870:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283875:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283881:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283886:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283891:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283896:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283901:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283906:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283912:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283916:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283921:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283926:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283990:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.283995:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284000:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284004:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284010:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284017:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284071:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284078:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284084:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284089:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284100:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284105:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284111:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284116:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284121:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284126:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284131:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284136:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284141:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284146:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284151:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.284161:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1785219921.285010:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219921.285104:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9cf34341be00:5798] 0 exiting: rc = 1 00000100:00100000:2.0:1785219921.285114:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9cf34341ac00:5799] 1 exiting: rc = 0 00000100:00100000:1.0:1785219921.285246:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285254:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285261:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285268:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285276:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285284:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285291:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285298:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285305:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285312:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285329:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285336:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285342:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285348:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285356:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285575:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285585:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285592:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285599:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285619:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285626:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285631:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285652:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285673:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285679:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285684:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285693:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285699:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285704:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285710:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285715:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285721:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285727:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285733:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285824:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285832:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285838:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285845:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285851:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285858:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285863:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285869:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285877:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285885:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285893:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285901:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285925:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285933:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285940:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285947:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285955:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285965:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285971:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285979:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285987:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.285994:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286001:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286011:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286042:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286050:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286056:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286063:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286070:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.286085:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219921.305249:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9cf34341a000:5801] 1 exiting: rc = 0 00000100:00100000:2.0:1785219921.305717:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9cf34341aa00:5800] 0 exiting: rc = 1 00000100:00100000:1.0:1785219921.305839:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305849:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305855:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305862:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305867:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305873:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305879:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305884:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305890:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305895:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305902:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305907:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305911:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305916:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305922:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.305927:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306000:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306006:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306012:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306017:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306022:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306028:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306033:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306039:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306044:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306049:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306054:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306059:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306065:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306092:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306098:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306103:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306108:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306113:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306119:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306125:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306130:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306135:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306140:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306145:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306151:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306155:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306161:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306166:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306171:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306176:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306181:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306187:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306192:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306198:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306203:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306208:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306213:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306218:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306223:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306229:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306235:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306240:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306245:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306250:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306255:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306260:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306265:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.306271:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.328013:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cf34341ba00:5803] 1 exiting: rc = 0 00000100:00100000:2.0:1785219921.330398:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cf34341a800:5802] 0 exiting: rc = 1 00000100:00100000:1.0:1785219921.330495:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330506:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330513:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330520:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330526:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330533:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330541:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330549:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330557:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330563:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330571:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330580:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330589:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330599:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330618:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330624:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330631:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330636:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330642:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330646:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330651:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330657:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330663:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.330669:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331770:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331789:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331799:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331808:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331816:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331823:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331830:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331837:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331843:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.331850:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332080:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332085:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332091:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332096:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332102:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332109:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332114:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332119:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332124:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332129:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332134:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332774:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332781:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332786:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332792:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332797:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332803:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332809:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332814:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332819:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332825:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332829:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332835:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332841:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332846:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332851:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332856:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332861:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332877:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.332885:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.338676:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cf34341b400:5804] 0 exiting: rc = 1 00000100:00100000:3.0:1785219921.339476:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cf34341b000:5805] 1 exiting: rc = 0 00000100:00100000:1.0:1785219921.340225:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340235:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340241:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340247:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340283:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340290:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340298:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340304:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340310:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340317:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340323:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340330:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340338:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340350:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340358:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340456:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340464:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340473:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340481:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340488:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340493:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340498:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340506:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340513:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340521:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340526:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340531:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340536:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340541:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340546:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340551:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340556:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340561:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340565:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340570:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340574:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340579:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340584:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340589:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340615:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340622:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340627:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340632:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340640:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340647:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340654:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340662:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340671:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340678:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340683:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340688:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340693:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340699:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340704:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340709:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340714:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340719:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340724:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340730:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340735:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340742:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340750:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340758:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.340764:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785219921.343065:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9cf3507f3600:5807] 1 exiting: rc = 0 00000100:00100000:0.0:1785219921.343694:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9cf3507dac00:5808] 2 exiting: rc = 0 00000100:00100000:3.0:1785219921.344070:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9cf34341b200:5806] 0 exiting: rc = 1 00000100:00100000:1.0:1785219921.344672:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344682:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344689:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344696:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344702:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344711:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344717:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344729:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344737:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344743:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344766:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344771:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344778:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344784:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344790:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344797:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344803:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344809:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344815:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344820:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344826:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344844:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344851:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344857:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344864:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344869:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344876:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344883:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344889:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344895:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344902:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344909:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344915:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344922:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.344997:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345008:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345014:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345021:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345029:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345034:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345041:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345046:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345052:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345058:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345064:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345092:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345099:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345105:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345111:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345118:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345124:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345131:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345137:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345145:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345151:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345157:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345163:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345169:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345177:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345183:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345190:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345195:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345202:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785219921.345219:0:12866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1785219921.354505:0:12866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219921.354723:0:12866:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1785219921.354731:0:12866:0:(genops.c:906:class_export_put()) final put ffff9cf344b92800/MDS_uuid 00000020:00000080:0.0:1785219921.354738:0:12866:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf344b92800/MDS_uuid for MDS 00000020:01000000:0.0:1785219921.354745:0:12866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1785219921.354910:0:12866:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1785219922.353103:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219922.861210:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465123200:0@lo:400:kworker.0 00000400:00000100:3.0:1785219922.861295:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871938465123200 offset 0 length 224: 4 00000100:00080000:0.0:1785219922.862811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1785219922.862822:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1785219922.862828:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf37e451000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785219922.862838:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1785219922.862847:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1785219922.862877:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cf37e451000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219922.862921:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf349c62680 x1871938465123328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785219922.862946:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1785219922.862950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1785219922.862952:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf34874d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785219922.862956:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1785219922.862959:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1785219922.862964:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cf34874d000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219922.862978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf349c60000 x1871938465123456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785219922.864577:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465123328:0@lo:38:kworker.0 00000400:00000100:2.0:1785219922.864664:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871938465123328 offset 0 length 520: 4 00000100:00100000:2.0:1785219922.864712:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465123456:0@lo:38:kworker.0 00000400:00000100:2.0:1785219922.864734:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871938465123456 offset 0 length 520: 4 00010000:00010000:3.0:1785219923.378048:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219924.403253:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1785219924.500832:0:13022:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1785219924.517460:0:13022:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1785219924.517523:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.517543:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.517552:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.517561:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.517594:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785219924.517601:0:13022:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1785219924.517628:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219924.517658:0:13022:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf349c62680 x1871938465123328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1785219937 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1785219924.517792:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219924.517802:0:11513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219924.517811:0:11513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cc800 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219924.517815:0:11513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219924.517824:0:11513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219924.517831:0:11513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219924.517837:0:11513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785219924.517840:0:11513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1785219924.517843:0:11513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1785219924.517890:0:11513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219924.517897:0:11513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219924.517927:0:11513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219924.517934:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf3413cc800/0x8b38d407a078c777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c77e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219924.517949:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219924.517957:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219924.517959:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219924.517980:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465123584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219924.518067:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219924.518153:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465123584 00000100:00100000:2.0:1785219924.518161:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465123584 00000100:00100000:2.0:1785219924.518201:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1785219924.518210:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1871938465123584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1785219924.518217:0:6603:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785219924 with bad export cookie 10032001299189908576 00000100:00100000:0.0:1785219924.522906:0:13022:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1785219924.522920:0:13022:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1785219924.522929:0:13022:0:(import.c:65:import_set_state_nolock()) ffff9cf37e451000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1785219924.522939:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219924.522950:0:13022:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf349c62680 x1871938465123328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1785219937 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219924.522959:0:13022:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1785219924.522962:0:13022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1785219924.529503:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465123328:0@lo:38:kworker.0 00010000:00010000:0.0:1785219924.530691:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530712:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530720:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530726:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530750:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219924.530758:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530765:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530772:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530798:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219924.530813:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1785219924.530818:0:13022:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1785219924.530849:0:13022:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1785219924.530855:0:13022:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1785219924.530861:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219924.530867:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785219924.530872:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9cf348668000) has no exports 00000020:00080000:0.0:1785219924.530903:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9cf348668000) has no exports 00000100:00100000:2.0:1785219924.532655:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1871938465123584:12345-0@lo:103:ldlm_bl.0 Request processed in 14436us (14578us total) trans 0 rc -107/-107 00000100:00100000:2.0:1785219924.532671:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1785219924.532864:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1785219924.532869:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9cf34a8c4000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1785219924.532873:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1785219924.533449:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785219924.533461:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219924.533474:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf341476600 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:3.0:1785219924.533499:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219924.533510:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785219924.533518:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219924.533525:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1785219924.533538:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1785219924.533542:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1785219924.533643:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219924.533654:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219924.533661:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1c00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219924.533674:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219924.533682:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219924.533688:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219924.533693:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1785219924.533705:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1785219924.533708:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:0.0:1785219924.534315:0:13022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf36cefa9c0 - data ffff9cf37da10d80/ffff9cf2461f9000 00000020:01000000:0.0:1785219924.534744:0:13022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf3494fa6c0 - data ffff9cf374b13798/ffff9cf24484a800 00000100:00080000:2.0:1785219924.543313:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.131@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1785219924.543319:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1785219924.543327:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf349c62a00 x1871938465123200/t0(0) o400->MGC192.168.203.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1785219938 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219924.543358:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf38114c380 x1871938465123584/t0(0) o103->MGC192.168.203.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1785219940 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1785219924.543399:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1785219924.543402:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1785219924.543405:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1785219924.543468:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6828c272-120a-44fd-b7c4-fcf074b0473f:3307:1871938465123200:0@lo:400:kworker.0 00010000:00010000:3.0:1785219924.543596:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219924.543609:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785219924.543642:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219924.543650:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341476600/0x8b38d407a078c785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c78c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219924.543739:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219924.543742:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219924.543746:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219924.543796:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219924.543804:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1785219924.543847:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6828c272-120a-44fd-b7c4-fcf074b0473f:0:1871938465123840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219924.543880:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219924.543887:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1c00/0x8b38d407a078c9bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8b38d407a078c9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219924.543898:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219924.543899:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219924.543901:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785219924.543917:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9cf34a8c4000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785219924.543927:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 196 00000100:00080000:2.0:1785219924.543992:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff9cf34a8c4000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1785219924.544351:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6828c272-120a-44fd-b7c4-fcf074b0473f:0:1871938465123712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219924.544475:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf38114d180 x1871938465123968/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785219924.544522:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6828c272-120a-44fd-b7c4-fcf074b0473f:3308:1871938465123584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219924.544658:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6828c272-120a-44fd-b7c4-fcf074b0473f:3305:1871938465123968:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1785219924.544796:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871938465123968 offset 0 length 520: 4 00100000:10000000:0.0:1785219924.557429:0:13022:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1785219924.617812:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c586 00000020:00000080:3.0:1785219924.617828:0:13022:0:(genops.c:906:class_export_put()) final put ffff9cf244b8d000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1785219924.617850:0:13022:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf349c7c000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1785219924.617855:0:13022:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf349c7c000 2 00000020:01000004:3.0:1785219924.617859:0:13022:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf349c7c000 from lustre-OST0000 00000020:00000080:3.0:1785219924.617905:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785219924.617917:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1785219924.617920:0:13022:0:(genops.c:906:class_export_put()) final put ffff9cf3486e9800/lustre-OST0000_UUID 00000020:00000080:3.0:1785219924.617924:0:13022:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf3486e9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1785219924.617932:0:13022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1785219924.617993:0:13022:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1785219924.617998:0:13022:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1785219924.618002:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785219924.618006:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1785219924.618014:0:13022:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cf244b8b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1785219924.618020:0:13022:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9cf245228000) has exports, disconnecting them 00000020:00080000:3.0:1785219924.618027:0:13022:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cf244b8b800), last request at 1785219719 00000020:00000080:3.0:1785219924.618031:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c5b0 00000020:00080000:3.0:1785219924.618041:0:13022:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf244b8b800): rc 0 00000020:00000080:3.0:1785219924.618047:0:13022:0:(genops.c:906:class_export_put()) final put ffff9cf244b8b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1785219924.618723:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf244b8d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1785219924.618745:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf244b8b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1785219924.619430:0:13022:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1785219924.619437:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219924.619442:0:13022:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1785219924.619450:0:13022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1785219924.619722:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219924.619733:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1785219924.619746:0:13022:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf349c7c000 1 00000020:00000080:0.0:1785219924.619752:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c540 00000020:00000080:0.0:1785219924.619760:0:13022:0:(genops.c:906:class_export_put()) final put ffff9cf343662800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1785219924.621551:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf37e451000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1785219924.621572:0:475:0:(genops.c:906:class_export_put()) final put ffff9cf244b8c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1785219924.621577:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf244b8c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1785219924.621614:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1785219924.624066:0:13022:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1785219924.624109:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219924.624122:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785219924.624130:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9cf349c519c0) has no exports 00000020:00000080:1.0:1785219924.626017:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf343662800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1785219924.652659:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785219924.652678:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1785219924.652685:0:13022:0:(genops.c:906:class_export_put()) final put ffff9cf349c7a000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1785219924.652691:0:13022:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf349c7a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1785219924.652708:0:13022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1785219924.652868:0:13022:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf349c7b000 00000020:02000400:1.0:1785219924.652920:0:13022:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1785219925.420794:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219926.448946:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1785219927.103228:0:13171:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1785219927.110593:0:13171:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1785219927.110828:0:13171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219927.110847:0:13171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219927.110857:0:13171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219927.110866:0:13171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219927.110888:0:13171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785219927.110895:0:13171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1785219927.110931:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219927.110949:0:13171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf349c60000 x1871938465123456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1785219937 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219927.110968:0:13171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1785219927.110976:0:13171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1785219927.110983:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1785219927.110985:0:13171:0:(import.c:65:import_set_state_nolock()) ffff9cf34874d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1785219927.110995:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.111006:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf354f81200 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219927.111023:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.111033:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219927.111041:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219927.111048:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785219927.111051:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1785219927.111054:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1785219927.111164:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785219927.111172:0:13171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf349c60000 x1871938465123456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1785219937 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219927.111181:0:13171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1785219927.111185:0:13171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:1.0:1785219927.111402:0:5782:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf34a8c4000 00010000:00010000:1.0:1785219927.111522:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.111601:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf354f81200/0x8b38d407a078c75b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c762 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.111616:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219927.111618:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219927.111620:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219927.111648:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465123456:0@lo:38:kworker.0 00010000:00010000:1.0:1785219927.115142:0:13171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115167:0:13171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115193:0:13171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115200:0:13171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115230:0:13171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219927.115238:0:13171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115245:0:13171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115251:0:13171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115258:0:13171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219927.115272:0:13171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1785219927.115277:0:13171:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1785219927.115317:0:13171:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1785219927.115323:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1785219927.115330:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785219927.115337:0:13171:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785219927.115343:0:13171:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9cf348068000) has no exports 00000020:00080000:1.0:1785219927.115398:0:13171:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9cf348068000) has no exports 00010000:00010000:2.0:1785219927.116004:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785219927.116017:0:11513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116028:0:11513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07600 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219927.116034:0:11513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116047:0:11513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219927.116056:0:11513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219927.116065:0:11513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785219927.116068:0:11513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1785219927.116071:0:11513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1785219927.116101:0:11513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf34a8c4000 00010000:00010000:2.0:1785219927.116105:0:11513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116112:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f07600/0x8b38d407a078c769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c770 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116146:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219927.116150:0:11513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116156:0:11513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cd600 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219927.116159:0:11513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116166:0:11513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219927.116172:0:11513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219927.116178:0:11513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1785219927.116180:0:11513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1785219927.116182:0:11513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1785219927.116187:0:11513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf34a8c4000 00010000:00010000:2.0:1785219927.116190:0:11513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116197:0:11513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf3413cd600/0x8b38d407a078c9ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c9b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.116211:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219927.116212:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219927.116214:0:11513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1785219927.117295:0:13171:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf24533ed20 - data ffff9cf36ff4d510/ffff9cf36f4db800 00010000:00010000:3.0:1785219927.117539:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1785219927.118539:0:13171:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9cf36cefa660 - data ffff9cf374bc36c0/ffff9cf2461fb800 00100000:10000000:0.0:1785219927.140726:0:13171:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1785219927.185390:0:13171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c65f 00000020:00000080:2.0:1785219927.185399:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf37e4b6800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1785219927.185438:0:13171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf37e4b1000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1785219927.185443:0:13171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf37e4b1000 2 00000020:01000004:2.0:1785219927.185448:0:13171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf37e4b1000 from lustre-OST0001 00000020:00000080:3.0:1785219927.185452:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf37e4b6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1785219927.185482:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785219927.185494:0:13171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1785219927.185497:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf37ed11800/lustre-OST0001_UUID 00000020:00000080:2.0:1785219927.185500:0:13171:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf37ed11800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1785219927.185513:0:13171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1785219927.185646:0:13171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6828c272-120a-44fd-b7c4-fcf074b0473f->MGS 00010000:00010000:2.0:1785219927.185661:0:13171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341477600/0x8b38d407a078c563 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c56a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219927.185673:0:13171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477600/0x8b38d407a078c563 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c56a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219927.185679:0:13171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1785219927.185682:0:13171:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1785219927.185686:0:13171:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1785219927.185701:0:13171:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf34a8c4000 00010000:00010000:2.0:1785219927.185705:0:13171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341477600/0x8b38d407a078c563 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c56a expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219927.185726:0:13171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8b38d407a078c7b6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219927.185733:0:13171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8b38d407a078c7b6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219927.185738:0:13171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785219927.185741:0:13171:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1785219927.185743:0:13171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1785219927.185756:0:13171:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf34a8c4000 00010000:00010000:2.0:1785219927.185766:0:13171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf341477000/0x8b38d407a078c7af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8b38d407a078c7b6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785219927.185792:0:13171:0:(import.c:65:import_set_state_nolock()) ffff9cf34a8c4000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1785219927.185795:0:13171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1785219927.185804:0:13171:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1785219927.185806:0:13171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1785219927.185810:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1785219927.185821:0:13171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf38114d180 x1871938465123968/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1785219934 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1785219927.185834:0:13171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1785219927.185837:0:13171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1785219927.186009:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6828c272-120a-44fd-b7c4-fcf074b0473f:3305:1871938465123968:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1785219927.186130:0:13171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1785219927.186142:0:13171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c452 00000020:00000080:2.0:1785219927.186151:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf344b90000/6828c272-120a-44fd-b7c4-fcf074b0473f 00000020:01000000:2.0:1785219927.186172:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.131@tcp (flags='') 00000020:00000080:2.0:1785219927.186178:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785219927.186183:0:13171:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1785219927.186187:0:13171:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9cf3486699c0) has no exports 00000020:00000080:3.0:1785219927.186250:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf344b90000/6828c272-120a-44fd-b7c4-fcf074b0473f for MGC192.168.203.131@tcp 10000000:01000000:0.0:1785219927.186452:0:5790:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1785219927.186468:0:13171:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.131@tcp: client import never connected 00000100:00080000:2.0:1785219927.186544:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1785219927.186547:0:13171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1785219927.186551:0:13171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1785219927.186554:0:13171:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1785219927.186742:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785219927.186748:0:13171:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.131@tcp (uuid 6828c272-120a-44fd-b7c4-fcf074b0473f) 00000020:01000000:2.0:1785219927.186752:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1785219927.186756:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785219927.186759:0:13171:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1785219927.186764:0:13171:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cf2462f6800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1785219927.186834:0:13171:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9cf371a70000) has exports, disconnecting them 00000020:00080000:2.0:1785219927.186839:0:13171:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cf2462f6800), last request at 1785219736 00000020:00000080:2.0:1785219927.186852:0:13171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c689 00000020:00080000:2.0:1785219927.186865:0:13171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf2462f6800): rc 0 00000020:00000080:2.0:1785219927.186868:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf2462f6800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1785219927.187122:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf34a8c4000 for MGC192.168.203.131@tcp 00000020:00000080:3.0:1785219927.187133:0:475:0:(genops.c:906:class_export_put()) final put ffff9cf351c13800/6828c272-120a-44fd-b7c4-fcf074b0473f 00000020:00000080:3.0:1785219927.187136:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf351c13800/6828c272-120a-44fd-b7c4-fcf074b0473f for MGC192.168.203.131@tcp 00000020:01000000:3.0:1785219927.187141:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.131@tcp (6828c272-120a-44fd-b7c4-fcf074b0473f) 00000020:00000080:3.0:1785219927.187884:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf2462f6800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1785219927.188044:0:13171:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1785219927.188050:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1785219927.188054:0:13171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1785219927.188059:0:13171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1785219927.188152:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1785219927.188419:0:475:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cf34874d000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1785219927.188745:0:11513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1785219927.188807:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1785219927.189040:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cf371b17a00:5777] 1 exiting: rc = 0 00000100:00100000:3.0:1785219927.189075:0:6602:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9cf244b41c00:6602] 2 exiting: rc = 0 00000100:00100000:3.0:1785219927.189476:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cf371b16800:5776] 0 exiting: rc = 1 00000100:00100000:0.0:1785219927.189585:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.190038:0:5778:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cf3494eea00:5778] 0 exiting: rc = 1 00000100:00100000:0.0:1785219927.190110:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cf3494ee000:5780] 2 exiting: rc = 0 00000100:00100000:3.0:1785219927.190211:0:5779:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9cf3494ee600:5779] 1 exiting: rc = 0 00000100:00100000:3.0:1785219927.193142:0:6603:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cf244b2a000:6603] 3 exiting: rc = 0 00000100:00100000:0.0:1785219927.193257:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193270:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193280:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193290:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193297:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193305:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193310:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193316:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193321:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193327:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193334:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193339:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193345:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193352:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193358:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193396:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193407:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193417:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193423:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193427:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193431:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193435:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193439:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193442:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193446:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193449:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193464:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193468:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193471:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193483:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193487:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193490:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193494:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193498:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193501:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193504:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193507:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193510:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193513:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193521:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193525:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193528:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193532:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193535:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193538:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193542:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193548:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193553:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193560:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193576:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193582:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193588:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193603:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193609:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193615:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193620:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193625:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193631:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193637:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193715:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193725:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193739:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193743:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.193749:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1785219927.195300:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785219927.195313:0:13171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1785219927.195319:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf37ed17800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1785219927.195325:0:13171:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf37ed17800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1785219927.195331:0:13171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1785219927.195417:0:13171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf37e4b1000 1 00000020:00000080:0.0:1785219927.195423:0:13171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8b38d407a078c62e 00000020:00000080:0.0:1785219927.195429:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf244b32000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1785219927.195446:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1785219927.195450:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785219927.195455:0:13171:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785219927.195460:0:13171:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9cf349c53380) has no exports 00000020:00000080:3.0:1785219927.195480:0:475:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf244b32000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1785219927.209805:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785219927.209826:0:13171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1785219927.209833:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf244b35800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1785219927.209839:0:13171:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf244b35800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1785219927.209852:0:13171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1785219927.210887:0:13171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf244b30800 00000020:01000000:3.0:1785219927.211109:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1785219927.211115:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785219927.211126:0:13171:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1785219927.211133:0:13171:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9cf34866b380) has no exports 00000020:00000080:3.0:1785219927.212731:0:13171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785219927.212755:0:13171:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1785219927.212762:0:13171:0:(genops.c:906:class_export_put()) final put ffff9cf343663000/OSS_uuid 00000020:00000080:3.0:1785219927.212767:0:13171:0:(genops.c:865:class_export_destroy()) destroying export ffff9cf343663000/OSS_uuid for OSS 00000020:01000000:3.0:1785219927.212780:0:13171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1785219927.213591:0:12778:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9cf244b2bc00:12778] 4 exiting: rc = 0 00000100:00100000:2.0:1785219927.213947:0:8158:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9cf37e4c3e00:8158] 3 exiting: rc = 0 00000100:00100000:1.0:1785219927.213952:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9cf38164aa00:6586] 0 exiting: rc = 1 00000100:00100000:2.0:1785219927.214102:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9cf35072c600:6588] 1 exiting: rc = 0 00000100:00100000:3.0:1785219927.214509:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9cf351999400:6589] 2 exiting: rc = 0 00000100:00080000:3.0:1785219927.214585:0:5789:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1785219927.214823:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214835:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214849:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214858:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214865:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214871:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214877:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214883:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214889:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214895:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.214901:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216198:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216205:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216211:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216218:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216224:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216230:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216236:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216242:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216248:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216255:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216261:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216266:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216272:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216279:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216284:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216290:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216296:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216301:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216307:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216314:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216319:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216325:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216331:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216337:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216342:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216348:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216354:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216360:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216391:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216397:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216403:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216409:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216415:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216420:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216425:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216442:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216448:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216454:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216460:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216465:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216471:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216477:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216484:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216489:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216505:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216512:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216517:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216523:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216529:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216539:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216545:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216876:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.216894:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.220537:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9cf351998000:6591] 1 exiting: rc = 0 00000100:00100000:1.0:1785219927.222948:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cf351998800:6590] 0 exiting: rc = 1 00000100:00100000:3.0:1785219927.223152:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223166:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223174:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223180:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223187:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223194:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223200:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223206:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223212:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223218:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223223:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223228:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223234:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223239:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223245:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223251:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223275:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223281:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223286:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223292:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223298:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223305:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223311:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223317:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223323:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223328:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223333:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223338:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223343:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223348:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223355:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223361:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223393:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223399:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223404:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223410:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223417:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223422:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223428:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223434:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223439:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223444:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223449:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223455:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223461:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223466:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223472:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223477:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223483:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223489:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223494:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223519:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223524:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223530:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223535:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223540:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223547:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223552:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223558:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223573:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223580:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223586:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223592:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785219927.223606:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785219927.229028:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9cf351998200:6593] 1 exiting: rc = 0 00000100:00100000:2.0:1785219927.229449:0:12017:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9cf244b2be00:12017] 3 exiting: rc = 0 00000100:00100000:3.0:1785219927.229799:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9cf351999c00:6594] 2 exiting: rc = 0 00000100:00100000:0.0:1785219927.230191:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cf351998400:6592] 0 exiting: rc = 1 00000100:00100000:0.0:1785219927.230380:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230393:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230400:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230406:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230413:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230419:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230425:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230431:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230437:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230443:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230449:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230456:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230462:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230469:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230475:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230481:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230487:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230511:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230517:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230536:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230543:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230548:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230553:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230560:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230580:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230588:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230594:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230709:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230716:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230722:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230727:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230733:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230739:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230744:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230750:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230756:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230763:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230768:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230773:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230779:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230784:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230790:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230796:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230817:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230824:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230830:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230835:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230841:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230848:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230854:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230860:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230866:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230879:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230889:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230896:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230902:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230908:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230914:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230922:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230929:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230946:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230954:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230960:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.230976:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785219927.237589:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cf36dc76e00:6595] 0 exiting: rc = 1 00000100:00100000:3.0:1785219927.238115:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cf36dc76400:6596] 1 exiting: rc = 0 00000100:00100000:0.0:1785219927.238435:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238446:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238455:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238463:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238471:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238478:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238483:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238488:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238496:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238505:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238511:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238517:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238523:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238529:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238535:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238541:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238547:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238553:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238559:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238576:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238582:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238587:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238592:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238622:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238627:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238634:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238640:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238647:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238652:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238657:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238662:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238667:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238672:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238678:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238683:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238688:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238694:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238699:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238704:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238709:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238714:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238719:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238724:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238730:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238735:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238741:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238746:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238752:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238757:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238763:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238768:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238774:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238780:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238786:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238791:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238798:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238805:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238810:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238824:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238830:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238835:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238840:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238845:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.238851:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785219927.240357:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cf38164a000:6597] 0 exiting: rc = 1 00000100:00100000:1.0:1785219927.240775:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9cf36dc71600:6598] 1 exiting: rc = 0 00000100:00100000:0.0:1785219927.240883:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240906:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240915:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240921:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240928:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240935:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240942:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240949:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240955:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.240962:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241092:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241100:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241107:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241133:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241143:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241149:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241157:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241164:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241171:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241178:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241185:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241191:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241198:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241205:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241211:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241236:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241244:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241251:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241258:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241284:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241291:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241297:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241305:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241314:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241321:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241331:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241338:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241478:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241490:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241497:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241505:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241513:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241521:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241528:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241535:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241542:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241548:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241553:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241560:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241593:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241671:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241679:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241687:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241693:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241699:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241705:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241714:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241721:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241727:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241733:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241739:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241745:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241751:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785219927.241767:0:13171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1785219927.258820:0:13171:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1785219943.726433:0:13787:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1785219951.388908:0:14201:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785219951.388913:0:14201:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1785219951.389032:0:14201:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9cf356ac9800 00000020:01000004:3.0:1785219951.389051:0:14201:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1785219951.389061:0:14201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785219951.389076:0:14201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9cf349c53380) 00000020:00000080:3.0:1785219951.389091:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1785219951.436724:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1785219951.443182:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1785219951.443784:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1785219951.443857:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1785219951.444112:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1785219951.444211:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1785219951.444311:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1785219951.444444:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1785219951.444530:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1785219951.444800:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1785219951.446147:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 592: rc = 0 00100000:10000000:1.0:1785219951.446228:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 592: rc = 0 00100000:10000000:1.0:1785219951.447042:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:1.0:1785219951.447512:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1785219951.447767:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:1.0:1785219951.448161:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:1.0:1785219951.448444:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1785219951.448857:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1785219951.449242:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1785219951.449747:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:1.0:1785219951.450095:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:1.0:1785219951.450354:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1785219951.450646:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:1.0:1785219951.450892:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1785219951.452114:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 189: rc = 0 00100000:10000000:1.0:1785219951.452382:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 189: rc = 0 00100000:10000000:1.0:1785219951.452725:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 189: rc = 0 00100000:10000000:1.0:1785219951.453105:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 189: rc = 0 00100000:10000000:1.0:1785219951.453474:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 189: rc = 0 00100000:10000000:1.0:1785219951.453815:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 189: rc = 0 00100000:10000000:1.0:1785219951.454196:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 189: rc = 0 00100000:10000000:1.0:1785219951.454479:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 189: rc = 0 00100000:10000000:1.0:1785219951.454784:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 189: rc = 0 00100000:10000000:1.0:1785219951.455159:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 189: rc = 0 00100000:10000000:1.0:1785219951.455508:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 189: rc = 0 00100000:10000000:1.0:1785219951.456089:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 189: rc = 0 00100000:10000000:1.0:1785219951.456404:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 189: rc = 0 00100000:10000000:1.0:1785219951.456797:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 189: rc = 0 00100000:10000000:1.0:1785219951.457202:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 189: rc = 0 00100000:10000000:1.0:1785219951.457556:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 189: rc = 0 00100000:10000000:1.0:1785219951.457816:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 189: rc = 0 00100000:10000000:1.0:1785219951.458218:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 189: rc = 0 00100000:10000000:1.0:1785219951.458525:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 189: rc = 0 00100000:10000000:1.0:1785219951.458781:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 189: rc = 0 00100000:10000000:1.0:1785219951.459449:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 189: rc = 0 00100000:10000000:1.0:1785219951.459707:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 189: rc = 0 00100000:10000000:1.0:1785219951.460106:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 189: rc = 0 00100000:10000000:1.0:1785219951.460500:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 189: rc = 0 00100000:10000000:1.0:1785219951.460776:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 189: rc = 0 00100000:10000000:1.0:1785219951.461045:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 189: rc = 0 00100000:10000000:1.0:1785219951.461286:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 189: rc = 0 00100000:10000000:1.0:1785219951.461576:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 189: rc = 0 00100000:10000000:1.0:1785219951.461872:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 189: rc = 0 00100000:10000000:1.0:1785219951.462097:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 189: rc = 0 00100000:10000000:1.0:1785219951.462324:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 189: rc = 0 00100000:10000000:1.0:1785219951.462597:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 189: rc = 0 00100000:10000000:1.0:1785219951.462939:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 658: rc = 0 00100000:10000000:1.0:1785219951.463766:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1785219951.464056:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 175: rc = 0 00100000:10000000:1.0:1785219951.464256:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1785219951.464326:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 175: rc = 0 00100000:10000000:1.0:1785219951.464549:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1785219951.464617:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 175: rc = 0 00100000:10000000:1.0:1785219951.465118:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1785219951.465186:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 593: rc = 0 00100000:10000000:1.0:1785219951.465478:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1785219951.465548:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 593: rc = 0 00100000:10000000:1.0:1785219951.465732:0:14201:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1785219951.465801:0:14201:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 593: rc = 0 00000020:00000080:1.0:1785219951.466205:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1785219951.466213:0:14201:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1785219951.466225:0:14201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078d753 00000020:01000004:1.0:1785219951.466233:0:14201:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1785219951.466237:0:14201:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1785219951.466242:0:14201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf356ac9800 from MGS 00000020:01000004:1.0:1785219951.466246:0:14201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1785219951.466255:0:14201:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cf371a719c0) 00000020:00000080:1.0:1785219951.466264:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1785219951.466332:0:14201:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf356ac9800 from MGS, refs=2 00080000:01000000:1.0:1785219951.466337:0:14201:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1785219951.466343:0:14201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078d761 00000100:00100000:1.0:1785219951.466472:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1785219951.466585:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1785219951.466591:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1785219951.467177:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1785219951.467184:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1785219951.468147:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219951.468310:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1785219951.468315:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1785219951.469167:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1785219951.469175:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1785219951.469582:0:14201:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1785219951.469587:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1785219951.470204:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219951.470208:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219951.470210:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219951.470551:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219951.470554:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219951.470555:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219951.471128:0:14201:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1785219951.477236:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1785219951.481287:0:14201:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1785219951.481307:0:14201:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1785219951.481310:0:14201:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1785219951.482879:0:14210:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1785219951.483151:0:14201:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1785219951.483243:0:14201:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1785219951.485281:0:14201:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1785219951.485674:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219951.485821:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1785219951.485827:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1785219951.494451:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1785219951.494470:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1785219951.495715:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1785219951.495725:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1785219951.496534:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1785219951.496552:0:14201:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.131@tcp' 00000020:01000004:0.0:1785219951.496554:0:14201:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1785219951.496582:0:14201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.131@tcp (typ=mgc) 00000020:00000080:0.0:1785219951.496594:0:14201:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.131@tcp (ffff9cf34806b380) 00000020:00000080:0.0:1785219951.496609:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1785219951.496679:0:14201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf3811b6800@MGC192.168.203.131@tcp: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1785219951.496816:0:14201:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.131@tcp-0 is initialized 00000040:01000000:0.0:1785219951.496822:0:14201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 1 is initialized 00000100:00080000:1.0:1785219951.498907:0:14215:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1785219951.503733:0:14216:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1785219951.503819:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.131@tcp (uuid 19240113-729d-48ac-b4dd-0e1109961383) 00000020:00000080:1.0:1785219951.503845:0:14201:0:(genops.c:1406:class_connect()) connect: client 19240113-729d-48ac-b4dd-0e1109961383, cookie 0x8b38d407a078d76f 00000100:00080000:1.0:1785219951.503857:0:14201:0:(import.c:510:import_select_connection()) MGC192.168.203.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785219951.503863:0:14201:0:(import.c:624:import_select_connection()) MGC192.168.203.131@tcp: import ffff9cf3811b6800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1785219951.503901:0:14201:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf3506c5180 x1871938465124096/t0(0) o250->MGC192.168.203.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785219951.503927:0:14201:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 19240113-729d-48ac-b4dd-0e1109961383->MGS 00000020:01000004:1.0:1785219951.503963:0:14201:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1785219951.503968:0:14201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1785219951.503983:0:14201:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9cf371a70000) 00000020:00000080:1.0:1785219951.503996:0:14201:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1785219951.504296:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19240113-729d-48ac-b4dd-0e1109961383:3305:1871938465124096:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1785219951.504391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219951.504506:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124096 00000100:00100000:0.0:1785219951.504514:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124096 00000100:00100000:0.0:1785219951.504551:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219951.504558:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3810b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1871938465124096:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1785219951.504582:0:14211:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 19240113-729d-48ac-b4dd-0e1109961383@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1785219951.504601:0:14211:0:(genops.c:1406:class_connect()) connect: client 19240113-729d-48ac-b4dd-0e1109961383, cookie 0x8b38d407a078d77d 00000100:00080000:0.0:1785219951.504722:0:14211:0:(import.c:65:import_set_state_nolock()) ffff9cf3811b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219951.504782:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3810b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+5:3305:x1871938465124096:12345-0@lo:250:mount.lustre.0 Request processed in 223us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.504789:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219951.504827:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1785219951.504835:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1785219951.504841:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1785219951.504853:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1785219951.504857:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf3811b6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1785219951.504860:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1785219951.504868:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1785219951.504873:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19240113-729d-48ac-b4dd-0e1109961383:3305:1871938465124096:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1785219951.528461:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219951.528675:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1785219951.528682:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1785219951.539495:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1785219951.539507:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1785219951.547021:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1785219951.547036:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1785219951.547827:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219951.549065:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1785219951.549077:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1785219951.549835:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1785219951.549843:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1785219951.628993:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219951.629237:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1785219951.629247:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1785219951.634760:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1785219951.634778:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1785219951.635748:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219951.635910:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1785219951.635915:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1785219951.640920:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1785219951.640983:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1785219951.652534:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219951.652714:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1785219951.652720:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1785219951.654234:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785219951.654248:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1785219951.654974:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785219951.655141:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1785219951.655145:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1785219951.655754:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785219951.655761:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1785219951.678816:0:14201:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785219951.679584:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1785219951.679591:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1785219951.686596:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1785219951.686609:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1785219951.688753:0:14201:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785219951.688768:0:14201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1785219951.691878:0:14201:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1785219951.691906:0:14201:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1785219951.691913:0:14201:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1785219951.692043:0:14201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785219951.692076:0:14201:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1785219951.692081:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785219951.692082:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785219951.692084:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219951.692085:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219951.692086:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219951.692088:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219951.692089:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785219951.692095:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785219951.692097:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219951.692098:0:14201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785219951.692101:0:14201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1785219951.692102:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785219951.692103:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785219951.692104:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219951.692105:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219951.692106:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219951.692107:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219951.692108:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785219951.692109:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785219951.692109:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219951.692110:0:14201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785219951.692146:0:14201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1785219951.692166:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124224:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1785219951.692243:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.692386:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.692533:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124224 00000100:00100000:0.0:1785219951.692542:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124224 00000100:00100000:0.0:1785219951.692593:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785219951.692603:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+5:14201:x1871938465124224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1785219951.692659:0:14214:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1785219951.692663:0:14214:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1785219951.692665:0:14214:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1785219951.693892:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1785219951.695104:0:14214:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1785219951.699481:0:14236:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1785219951.699489:0:14236:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1785219951.699492:0:14236:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1785219951.699523:0:14236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1785219951.701919:0:14214:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1785219951.701940:0:14214:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1785219951.715278:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+5:14201:x1871938465124224:12345-0@lo:253:mount.lustre.0 Request processed in 22660us (23018us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219951.715306:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219951.715342:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1785219951.715410:0:14201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785219951.715415:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785219951.715418:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785219951.715421:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219951.715422:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219951.715423:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219951.715424:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219951.715426:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785219951.715428:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785219951.715430:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219951.715431:0:14201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785219951.715469:0:14201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf356ac9800 from lustre-MDT0000 10000000:01000000:1.0:1785219951.715495:0:14201:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1785219951.715498:0:14201:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1785219951.715502:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cf34806b380 10000000:01000000:1.0:1785219951.715506:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785219951.715515:0:14201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf34806b380 from 1 10000000:01000000:1.0:1785219951.715518:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785219951.715556:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.715568:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.715588:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219951.715607:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785219951.715679:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.715732:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219951.716488:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124352 00000100:00100000:3.0:1785219951.716503:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124352 00000100:00100000:3.0:1785219951.716564:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219951.716575:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+5:14201:x1871938465124352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219951.716596:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219951.716624:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078d78b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d784 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.716763:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078d78b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d784 expref: 6 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.716775:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06e00/0x8b38d407a078d78b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d784 expref: 6 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.716787:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06e00, rc 0) 00000100:00100000:3.0:1785219951.716861:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+6:14201:x1871938465124352:12345-0@lo:101:mount.lustre.0 Request processed in 288us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219951.716869:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219951.716943:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219951.716966:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.716977:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219951.717043:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219951.717090:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.717129:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219951.717764:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124480 00000100:00100000:3.0:1785219951.717775:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124480 00000100:00100000:3.0:1785219951.717823:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219951.717836:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+6:14201:x1871938465124480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785219951.719493:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+6:14201:x1871938465124480:12345-0@lo:501:mount.lustre.0 Request processed in 1650us (2390us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785219951.719509:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785219951.724056:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124480:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1785219951.724107:0:14201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785219951.724178:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.724193:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219951.724203:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf356ac9800 10000000:01000000:1.0:1785219951.724214:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785219951.724221:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cf356ac9800 10000000:01000000:1.0:1785219951.724224:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1785219951.724227:0:14201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9cf356ac9800 from 1 10000000:01000000:1.0:1785219951.724230:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1785219951.724287:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28e00/0x8b38d407a078d792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.724306:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a28e00/0x8b38d407a078d792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.724318:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a28e00/0x8b38d407a078d792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219951.724342:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785219951.724462:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.724509:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219951.727443:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124608 00000100:00100000:3.0:1785219951.727471:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124608 00000100:00100000:3.0:1785219951.727588:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785219951.727605:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+6:14201:x1871938465124608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219951.727643:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219951.727675:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06600/0x8b38d407a078d799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d792 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.727714:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06600/0x8b38d407a078d799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d792 expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.727726:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06600/0x8b38d407a078d799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d792 expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.727738:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06600, rc 0) 00000100:00100000:3.0:1785219951.727848:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+7:14201:x1871938465124608:12345-0@lo:101:mount.lustre.0 Request processed in 250us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219951.727857:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785219951.727972:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219951.728003:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a28e00/0x8b38d407a078d792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d799 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.728016:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a28e00/0x8b38d407a078d792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d799 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219951.728058:0:14201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1785219951.728065:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28e00/0x8b38d407a078d792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d799 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.728072:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a28e00/0x8b38d407a078d792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d799 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219951.728081:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1785219951.728088:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785219951.728094:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cf356ac9800 10000000:01000000:2.0:1785219951.728096:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1785219951.728100:0:14201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1785219951.728103:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1785219951.728137:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf37edc8400/0x8b38d407a078d7a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.728144:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf37edc8400/0x8b38d407a078d7a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.728153:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf37edc8400/0x8b38d407a078d7a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219951.728174:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1785219951.728240:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219951.728290:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4240 going to sleep for 11 seconds 00000100:00100000:3.0:1785219951.728422:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124736 00000100:00100000:3.0:1785219951.728431:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124736 00000100:00100000:3.0:1785219951.728473:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785219951.728483:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+7:14201:x1871938465124736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219951.728496:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219951.728510:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07200/0x8b38d407a078d7a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d7a0 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.728532:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07200/0x8b38d407a078d7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d7a0 expref: 8 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.728543:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07200/0x8b38d407a078d7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d7a0 expref: 8 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.728566:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07200, rc 0) 00000100:00100000:3.0:1785219951.728620:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+8:14201:x1871938465124736:12345-0@lo:101:mount.lustre.0 Request processed in 140us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219951.728627:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219951.728670:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219951.728684:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf37edc8400/0x8b38d407a078d7a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d7a7 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.728701:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf37edc8400/0x8b38d407a078d7a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d7a7 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219951.728768:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219951.728807:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219951.728836:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4240 going to sleep for 11 seconds 00000100:00100000:3.0:1785219951.729213:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124864 00000100:00100000:3.0:1785219951.729222:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124864 00000100:00100000:3.0:1785219951.729270:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785219951.729278:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+8:14201:x1871938465124864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785219951.732273:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+9:14201:x1871938465124864:12345-0@lo:501:mount.lustre.0 Request processed in 2983us (3453us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219951.732292:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785219951.732344:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219951.732446:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785219951.732527:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219951.732607:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e4240 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.732629:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465124992 00000100:00100000:0.0:1785219951.732650:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465124992 00000100:00100000:0.0:1785219951.732722:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219951.732732:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+9:14201:x1871938465124992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785219951.733322:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+9:14201:x1871938465124992:12345-0@lo:503:mount.lustre.0 Request processed in 590us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.733333:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785219951.733875:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465124992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219951.736435:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14237:1871938465125120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219951.736539:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.736596:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5240 going to sleep for 11 seconds 00000100:00100000:2.0:1785219951.736835:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465125120 00000100:00100000:2.0:1785219951.736844:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465125120 00000100:00100000:2.0:1785219951.736892:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785219951.736902:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+9:14237:x1871938465125120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219951.737243:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+9:14237:x1871938465125120:12345-0@lo:502:llog_process_th.0 Request processed in 340us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219951.737440:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785219951.737600:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14237:1871938465125120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785219951.737631:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219951.737710:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219951.737712:0:14237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785219951.737717:0:14237:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1785219951.737788:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785219951.737804:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cf371a73380) 00000020:00000080:1.0:1785219951.737826:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1785219951.737832:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1785219951.737921:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1785219951.737929:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078d7b5 00000020:00000080:1.0:1785219951.738145:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1785219951.740341:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219951.740803:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219951.740807:0:14237:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1785219951.740817:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785219951.740823:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219951.740825:0:14237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1785219951.740829:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785219951.740845:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cf24522cd40) 00000020:00000080:2.0:1785219951.740883:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1785219951.740889:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1785219951.740891:0:14237:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1785219951.740893:0:14237:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1785219951.740900:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785219951.740977:0:14237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf356ac9800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1785219951.740992:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cf2452299c0) 00000020:00000080:2.0:1785219951.740999:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1785219951.741045:0:14237:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1785219951.741051:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078d7ca 00000020:00000080:2.0:1785219951.741187:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1785219951.741197:0:14237:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1785219951.741201:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8b38d407a078d7d1 00080000:01000000:2.0:1785219951.741207:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1785219951.741211:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078d7d8 00010000:00010000:2.0:1785219951.878445:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1785219951.879796:0:14237:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1785219951.880142:0:14237:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1785219951.881477:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9cf24522b380) 00000020:00000080:2.0:1785219951.881508:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1785219951.881589:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1785219951.881601:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078d7e6 00000020:00000080:0.0:1785219951.885246:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1785219951.899509:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8b38d407a078d7ed 00000020:00000080:0.0:1785219951.899919:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1785219951.899932:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219951.899939:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.899941:0:14237:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1785219951.899943:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219951.899950:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.899951:0:14237:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1785219951.899955:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1785219951.900001:0:14237:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1785219951.900014:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219951.900018:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.900019:0:14237:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1785219951.900021:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1785219951.900023:0:14237:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1785219951.900024:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785219951.900026:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785219951.900027:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1785219951.900029:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.900031:0:14237:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1785219951.900033:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785219951.900036:0:14237:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1785219951.900039:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.900041:0:14237:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1785219951.900044:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1785219951.900049:0:14237:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1785219951.900074:0:14237:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1785219951.900076:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785219951.900090:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cf34806cd40) 00000020:00000080:0.0:1785219951.900105:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1785219951.900110:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1785219951.900162:0:14237:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1785219951.900175:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1785219951.900182:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078d7fb 00010000:00080000:0.0:1785219951.900214:0:14237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf2462f3800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1785219951.900466:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1785219951.903795:0:14237:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1785219951.903846:0:14237:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1785219951.907021:0:14237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785219951.907098:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1785219951.907870:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1785219951.908968:0:14241:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1785219951.908975:0:14241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1785219951.910155:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785219951.910169:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785219951.910202:0:14237:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1785219951.910222:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078d802 00000100:00080000:0.0:1785219951.910232:0:14237:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785219951.910238:0:14237:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf2462f3800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219951.910281:0:14237:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf349c62a00 x1871938465125248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785219951.910310:0:14237:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1785219951.910387:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219951.910473:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.910476:0:14237:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1785219951.910480:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1785219951.910483:0:14237:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1785219951.910485:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785219951.910486:0:14237:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785219951.910487:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1785219951.910491:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.910492:0:14237:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1785219951.910494:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785219951.910497:0:14237:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1785219951.910500:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.910511:0:14237:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1785219951.910515:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1785219951.910518:0:14237:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.131@tcp to nid 0x20000c0a8cb83 (192.168.203.131@tcp) 00000020:01000000:0.0:1785219951.910551:0:14237:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1785219951.910554:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785219951.910566:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cf3480699c0) 00000020:00000080:0.0:1785219951.910784:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1785219951.910792:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1785219951.910860:0:14237:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1785219951.910866:0:14237:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1785219951.910871:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8b38d407a078d810 00010000:00080000:0.0:1785219951.910903:0:14237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf342ddf000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:0.0:1785219951.911099:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1785219951.911960:0:14237:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1785219951.911982:0:14237:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1785219951.912537:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465125248:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1785219951.912605:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871938465125248 offset 0 length 520: 4 00000040:00080000:0.0:1785219951.913509:0:14237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785219951.913699:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1785219951.913762:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1785219951.914233:0:14243:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1785219951.914238:0:14243:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1785219951.916045:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785219951.916056:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785219951.916081:0:14237:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1785219951.916096:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078d817 00000100:00080000:0.0:1785219951.916106:0:14237:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785219951.916112:0:14237:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf342ddf000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219951.916149:0:14237:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf349c62d80 x1871938465125376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785219951.916209:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465125376:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1785219951.916281:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871938465125376 offset 0 length 520: 4 00000100:00080000:0.0:1785219951.916333:0:14237:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1785219951.916436:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219951.916440:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.916442:0:14237:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1785219951.916451:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219951.916456:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.916457:0:14237:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785219951.916460:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785219951.916462:0:14237:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785219951.916465:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219951.916480:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.916481:0:14237:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1785219951.916484:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219951.916486:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.916487:0:14237:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785219951.916491:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1785219951.916519:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14237:1871938465125504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219951.916570:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219951.916603:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465125504 00000100:00100000:0.0:1785219951.916609:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465125504 00000100:00100000:0.0:1785219951.916655:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785219951.916664:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+9:14237:x1871938465125504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785219951.916889:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+9:14237:x1871938465125504:12345-0@lo:502:llog_process_th.0 Request processed in 226us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.916898:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785219951.916956:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348223780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.917109:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14237:1871938465125504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785219951.917136:0:14237:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219951.917141:0:14237:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219951.917143:0:14237:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785219951.917147:0:14237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1785219951.917197:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1785219951.917215:0:14201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1785219951.917229:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf37edc8400/0x8b38d407a078d7a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d7a7 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219951.917245:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf37edc8400/0x8b38d407a078d7a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d7a7 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219951.917253:0:14201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf356ac9800 from 1 10000000:01000000:0.0:1785219951.917256:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785219951.917281:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219951.917289:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219951.917297:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219951.917311:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465125632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785219951.917337:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219951.917349:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348bc7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219951.917930:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465125632 00000100:00100000:2.0:1785219951.917937:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465125632 00000100:00100000:2.0:1785219951.917969:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785219951.917977:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+9:14201:x1871938465125632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219951.917988:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219951.918003:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d81e expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.918024:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d81e expref: 10 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.918043:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d81e expref: 10 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.918052:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9c00, rc 0) 00000100:00100000:2.0:1785219951.918087:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+10:14201:x1871938465125632:12345-0@lo:101:mount.lustre.0 Request processed in 111us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219951.918094:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785219951.918102:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465125632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219951.918115:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.918124:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219951.919088:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465125760:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1785219951.919137:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.919176:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.919187:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465125760 00000100:00100000:0.0:1785219951.919192:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465125760 00000100:00100000:0.0:1785219951.919224:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785219951.919232:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+10:14201:x1871938465125760:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1785219951.919247:0:14213:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1785219951.919253:0:14213:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1785219951.919327:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+10:14201:x1871938465125760:12345-0@lo:256:mount.lustre.0 Request processed in 96us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.919333:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785219951.919438:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465125760:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1785219951.920234:0:14201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1785219951.920258:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.920284:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219951.920292:0:14201:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf356ac9800 from 1 10000000:01000000:1.0:1785219951.920295:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785219951.920323:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.920330:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.920337:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219951.920352:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465125888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785219951.920599:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.920665:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.925750:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465125888 00000100:00100000:0.0:1785219951.925786:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465125888 00000100:00100000:0.0:1785219951.925851:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785219951.925859:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+10:14201:x1871938465125888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785219951.925875:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219951.925897:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d82c expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219951.925923:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d82c expref: 11 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219951.925934:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d82c expref: 11 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219951.925943:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0400, rc 0) 00000100:00100000:0.0:1785219951.926022:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+11:14201:x1871938465125888:12345-0@lo:101:mount.lustre.0 Request processed in 163us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.926029:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785219951.926066:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465125888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219951.926086:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219951.926097:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219951.926171:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219951.926206:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219951.926250:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2462e49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.926598:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126016 00000100:00100000:0.0:1785219951.926604:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126016 00000100:00100000:0.0:1785219951.926636:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785219951.926643:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+11:14201:x1871938465126016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785219951.927215:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+11:14201:x1871938465126016:12345-0@lo:501:mount.lustre.0 Request processed in 572us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.927224:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785219951.929613:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785219951.929804:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785219951.929892:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219951.929939:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf245350600 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.930000:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126144 00000100:00100000:0.0:1785219951.930007:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126144 00000100:00100000:0.0:1785219951.930073:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219951.930081:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+11:14201:x1871938465126144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785219951.930294:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+11:14201:x1871938465126144:12345-0@lo:503:mount.lustre.0 Request processed in 213us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.930301:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785219951.930487:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219951.931016:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14245:1871938465126272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219951.931063:0:14245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.931099:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1785219951.932617:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126272 00000100:00100000:2.0:1785219951.932629:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126272 00000100:00100000:2.0:1785219951.932681:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785219951.932691:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36f4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+11:14245:x1871938465126272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219951.932990:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36f4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+11:14245:x1871938465126272:12345-0@lo:502:llog_process_th.0 Request processed in 300us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219951.932998:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785219951.933310:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14245:1871938465126272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785219951.933346:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219951.933356:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219951.933358:0:14245:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1785219951.935477:0:14245:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf356ac9800 00000020:00000080:1.0:1785219951.935483:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785219951.935494:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219951.935511:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219951.935512:0:14245:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1785219951.935517:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219951.935520:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219951.935522:0:14245:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1785219951.935525:0:14245:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf356ac9800 00000020:00000080:1.0:1785219951.935528:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785219951.935583:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219951.935586:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219951.935587:0:14245:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1785219951.935590:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219951.935592:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219951.935593:0:14245:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1785219951.935597:0:14245:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf356ac9800 00000020:00000080:1.0:1785219951.935599:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1785219951.935722:0:14245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14245:1871938465126400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219951.935803:0:14245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.935851:0:14245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1785219951.936152:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126400 00000100:00100000:3.0:1785219951.936160:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126400 00000100:00100000:3.0:1785219951.936217:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785219951.936227:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36f4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+11:14245:x1871938465126400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785219951.936512:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36f4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+11:14245:x1871938465126400:12345-0@lo:502:llog_process_th.0 Request processed in 287us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219951.936521:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785219951.936735:0:14245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14245:1871938465126400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785219951.936762:0:14245:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219951.936769:0:14245:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219951.936771:0:14245:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1785219951.936775:0:14245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1785219951.936929:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1785219951.936949:0:14201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219951.937005:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.937018:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219951.937065:0:14201:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785219951.937068:0:14201:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf356ac9800 10000000:01000000:3.0:1785219951.937071:0:14201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf356ac9800 10000000:01000000:3.0:1785219951.937075:0:14201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785219951.937081:0:14201:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf356ac9800 from 1 10000000:01000000:3.0:1785219951.937083:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785219951.937113:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078d83a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.937122:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078d83a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.937130:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078d83a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219951.937154:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785219951.937186:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219951.937223:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2453503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219951.937534:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126528 00000100:00100000:1.0:1785219951.937539:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126528 00000100:00100000:1.0:1785219951.937567:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785219951.937574:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36f4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+11:14201:x1871938465126528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219951.937590:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219951.937605:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf348a28a00/0x8b38d407a078d841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d83a expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.937649:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf348a28a00/0x8b38d407a078d841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d83a expref: 12 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.937659:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf348a28a00/0x8b38d407a078d841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d83a expref: 12 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219951.937668:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28a00, rc 0) 00000100:00100000:1.0:1785219951.937701:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36f4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14201:x1871938465126528:12345-0@lo:101:mount.lustre.0 Request processed in 127us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219951.937708:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785219951.937784:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219951.937796:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078d83a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d841 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.937805:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078d83a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d841 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219951.937872:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785219951.937908:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219951.937938:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2453503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219951.937983:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126656 00000100:00100000:0.0:1785219951.937989:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126656 00000100:00100000:0.0:1785219951.938026:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785219951.938035:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14201:x1871938465126656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785219951.938338:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14201:x1871938465126656:12345-0@lo:501:mount.lustre.0 Request processed in 304us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219951.938346:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785219951.938562:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785219951.938591:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785219951.938630:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219951.938658:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2453503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219951.938929:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126784 00000100:00100000:1.0:1785219951.938934:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126784 00000100:00100000:1.0:1785219951.938968:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785219951.938975:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14201:x1871938465126784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219951.939198:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14201:x1871938465126784:12345-0@lo:503:mount.lustre.0 Request processed in 223us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219951.939206:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785219951.939966:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465126784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219951.946004:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14247:1871938465126912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219951.946087:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219951.946134:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219951.948716:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465126912 00000100:00100000:2.0:1785219951.948730:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465126912 00000100:00100000:2.0:1785219951.948796:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785219951.948806:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+12:14247:x1871938465126912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219951.949099:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+12:14247:x1871938465126912:12345-0@lo:502:llog_process_th.0 Request processed in 294us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219951.949450:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785219951.949509:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14247:1871938465126912:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1785219951.949575:0:14247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1785219951.949589:0:14247:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cf371a74d40) 00000020:00000080:1.0:1785219951.949607:0:14247:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1785219951.950486:0:14247:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf356ac9800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1785219951.950492:0:14247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf356ac9800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1785219951.950501:0:14247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf356ac9800 4 00010000:00080000:1.0:1785219951.950534:0:14247:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf345ce2800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.131@tcp at head 00010000:00010000:1.0:1785219951.954784:0:14247:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1785219951.954889:0:14247:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1785219951.954939:0:14247:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785219951.954960:0:14247:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8b38d407a078d84f 00000100:00080000:1.0:1785219951.954971:0:14247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785219951.954977:0:14247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cf345ce2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1785219951.955013:0:14247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf3506c5500 x1871938465127040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785219951.955051:0:14247:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1785219951.955087:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465127040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785219951.955164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219951.955388:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127040 00000100:00100000:0.0:1785219951.955403:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127040 00000100:00100000:0.0:1785219951.955445:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219951.955453:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1871938465127040:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785219951.955519:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1871938465127040:12345-0@lo:38:llog_process_th.0 Request processed in 65us (354us total) trans 0 rc -11/-11 00000100:00100000:0.0:1785219951.955527:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219951.955571:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785219951.955578:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf345ce2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785219951.955583:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1785219951.955586:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465127040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1785219951.959202:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14247:1871938465127168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785219951.959290:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219951.959333:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348731e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219951.960838:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127168 00000100:00100000:1.0:1785219951.960850:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127168 00000100:00100000:1.0:1785219951.960897:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785219951.960906:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14247:x1871938465127168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785219951.961175:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14247:x1871938465127168:12345-0@lo:502:llog_process_th.0 Request processed in 270us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219951.961183:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785219951.961311:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19240113-729d-48ac-b4dd-0e1109961383:14247:1871938465127168:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1785219951.961341:0:14247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1785219951.962738:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1785219951.962775:0:14201:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785219951.962802:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078d83a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d841 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219951.962814:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07400/0x8b38d407a078d83a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d841 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785219951.962864:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785219951.962866:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785219951.962868:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219951.962869:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219951.962870:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219951.962872:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219951.962873:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785219951.962875:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785219951.962876:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219951.962878:0:14201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785219951.962881:0:14201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1785219951.962883:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785219951.962885:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785219951.962886:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219951.962887:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219951.962888:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219951.962889:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219951.962890:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785219951.962891:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785219951.962892:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219951.962893:0:14201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785219951.962914:0:14201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1785219951.962929:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465127296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1785219951.962982:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219951.963019:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6780 going to sleep for 11 seconds 00000100:00100000:2.0:1785219951.963204:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127296 00000100:00100000:2.0:1785219951.963212:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127296 00000100:00100000:2.0:1785219951.963263:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785219951.963273:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14201:x1871938465127296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785219951.963303:0:14213:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1785219951.963317:0:14213:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1785219952.016745:0:14213:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1785219952.016765:0:14213:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1785219952.017209:0:14235:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785219952.017214:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785219952.017237:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219952.017256:0:14235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d81e expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219952.017284:0:14235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219952.017326:0:14235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078d81e expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219952.017341:0:14235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078d81e expref: 12 pid: 14214 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219952.017356:0:14235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1871938465127424:0@lo:104: 00000100:00100000:1.0:1785219952.017464:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219952.017501:0:14235:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219952.017634:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127424 00000100:00100000:2.0:1785219952.017642:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127424 00000100:00100000:2.0:1785219952.017689:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785219952.017699:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19240113-729d-48ac-b4dd-0e1109961383+3:14235:x1871938465127424:12345-0@lo:104: 00010000:00010000:2.0:1785219952.017713:0:14202:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.017766:0:14202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785219952.017772:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19240113-729d-48ac-b4dd-0e1109961383+3:14235:x1871938465127424:12345-0@lo:104: Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219952.017779:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1785219952.017800:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219952.017813:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.017820:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1400 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219952.017825:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.017834:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219952.017841:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219952.017847:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1785219952.017876:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.017883:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219952.017905:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.017912:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf3489b1400/0x8b38d407a078d81e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d825 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.017929:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219952.017931:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219952.017932:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219952.017968:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19240113-729d-48ac-b4dd-0e1109961383:3307:1871938465127552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219952.017995:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219952.018056:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127552 00000100:00100000:2.0:1785219952.018065:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127552 00010000:00010000:2.0:1785219952.018083:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d81e expref: 13 pid: 14214 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219952.018103:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785219952.018109:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+13:3307:x1871938465127552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219952.018128:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219952.018134:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d81e expref: 13 pid: 14214 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018143:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078d81e expref: 13 pid: 14214 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018231:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018240:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1785219952.018253:0:14204:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001039891s 00010000:00010000:2.0:1785219952.018258:0:14204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018264:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018270:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018276:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018291:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219952.018294:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018694:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018704:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219952.018714:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219952.018751:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+13:3307:x1871938465127552:12345-0@lo:103:ldlm_bl.0 Request processed in 641us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219952.018758:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785219952.018955:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19240113-729d-48ac-b4dd-0e1109961383:3307:1871938465127552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219952.019055:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078d825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078d81e expref: 12 pid: 14214 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219952.019069:0:14235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1871938465127424:0@lo:104: 00010000:00010000:1.0:1785219952.019084:0:14235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219952.019092:0:14235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219952.019098:0:14235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219952.019104:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf348a28800/0x8b38d407a078d856 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219952.028788:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+11:14201:x1871938465127296:12345-0@lo:253:mount.lustre.0 Request processed in 65508us (65798us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219952.028804:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785219952.028911:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14201:1871938465127296:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1785219952.028926:0:14201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1785219952.028941:0:14201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785219952.028944:0:14201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1785219952.028945:0:14201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785219952.028946:0:14201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785219952.028947:0:14201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785219952.028949:0:14201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785219952.028950:0:14201:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1785219952.028952:0:14201:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1785219952.028953:0:14201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785219952.028955:0:14201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1785219952.028969:0:14201:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1785219952.043882:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219952.044048:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219952.044340:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219952.044532:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1785219952.044827:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1785219952.044985:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1785219952.046271:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1785219952.046474:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1785219952.046865:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1785219952.047091:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1785219952.047384:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1785219952.049904:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1785219952.126713:0:14201:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1785219952.127724:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1785219952.128001:0:14258:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1785219952.128010:0:14258:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1785219952.128084:0:14259:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1785219952.128256:0:14259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219952.132188:0:14259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1785219952.132612:0:14259:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1785219952.132618:0:14259:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1785219952.140779:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1785219952.140939:0:14201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1785219952.141700:0:14201:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1785219952.141711:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1785219952.141898:0:14201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785219952.144254:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1785219952.146159:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1785219952.146229:0:14201:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1785219952.150027:0:14201:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1785219952.155836:0:14201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1785219952.218533:0:14201:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1785219952.218597:0:14201:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcd6c15af988 00100000:10000000:0.0:1785219952.218610:0:14201:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1785219952.219714:0:14201:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1785219952.219847:0:14201:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1785219952.219870:0:14201:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1785219952.219891:0:14201:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1785219952.501240:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785219953.004837:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1785219953.323955:0:14216:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1785219953.323966:0:14216:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf356ac9800 from 6 10000000:01000000:3.0:1785219953.323973:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1785219953.324032:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219953.324060:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219953.324073:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219953.324106:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465127680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785219953.324197:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219953.324254:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6540 going to sleep for 11 seconds 00000100:00100000:1.0:1785219953.324905:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127680 00000100:00100000:1.0:1785219953.324917:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127680 00000100:00100000:1.0:1785219953.324984:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785219953.324995:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+11:14216:x1871938465127680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785219953.325013:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219953.325180:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d85d expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219953.325225:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d85d expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219953.325238:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d85d expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219953.325248:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a29a00, rc 0) 00000100:00100000:1.0:1785219953.325344:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465127680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 350us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219953.325353:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785219953.325594:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465127680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785219953.325612:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219953.325622:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219953.325708:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465127808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1785219953.325760:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219953.325798:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1785219953.325947:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127808 00000100:00100000:3.0:1785219953.325956:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127808 00000100:00100000:3.0:1785219953.326014:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785219953.326023:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465127808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1785219953.326056:0:14213:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1785219953.326078:0:14213:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1785219953.326082:0:14213:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1785219953.326200:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465127808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219953.326212:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785219953.326268:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465127808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1785219953.326332:0:14216:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1785219953.326343:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219953.326354:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219953.518611:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785219954.028557:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785219954.542532:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219955.563859:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219956.594400:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785219957.121116:0:14501:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1785219957.164588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219957.164596:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785219957.164599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219957.164603:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785219957.164605:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1785219957.164608:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1785219957.164611:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf345ce2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785219957.164623:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cf345ce2800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1785219957.164650:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf3506c6680 x1871938465128064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785219957.165416:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785219957.165434:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465127936:0@lo:400:kworker.0 00000100:00100000:1.0:1785219957.165506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219957.165563:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465128064:0@lo:38:kworker.0 00000100:00100000:1.0:1785219957.165597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219957.169042:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465128064 00000100:00100000:2.0:1785219957.169064:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465128064 00000100:00100000:2.0:1785219957.169111:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219957.169119:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1871938465128064:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1785219957.169148:0:14221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1785219957.169196:0:14221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8b38d407a078d86b 00000004:00100000:2.0:1785219957.169215:0:14221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1785219957.169337:0:14221:0:(import.c:65:import_set_state_nolock()) ffff9cf3518f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785219957.169447:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871938465128064:12345-0@lo:38:kworker.0 Request processed in 328us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219957.169456:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785219957.169507:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf3506c6680 x1871938465128064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785219967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785219957.169523:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1785219957.169531:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1785219957.169536:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785219957.169538:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf345ce2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1785219957.169545:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871938465128064:0@lo:38:kworker.0 00000100:00100000:0.0:1785219957.170041:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465127936 00000100:00100000:0.0:1785219957.170048:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465127936 00000100:00100000:0.0:1785219957.170097:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785219957.170105:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:3309:x1871938465127936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219957.170158:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:3309:x1871938465127936:12345-0@lo:400:kworker.0 Request processed in 55us (4652us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219957.170165:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785219957.170208:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465127936:0@lo:400:kworker.0 00010000:00010000:3.0:1785219957.611577:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219958.635953:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219959.659546:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785219960.184538:0:14652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4af57cf0 20000000:00000080:1.0:1785219960.184556:0:14652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf349b37000 uarg=0000000000000000 20000000:01000000:1.0:1785219960.184588:0:14652:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1785219960.184595:0:14652:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1785219960.184599:0:14652:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1785219960.193203:0:14653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1785219960.194891:0:14652:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1785219960.208651:0:14652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1785219960.209885:0:14652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219960.209909:0:14652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d82c expref: 11 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219960.209917:0:14652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219960.209962:0:14652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078d82c expref: 11 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219960.209976:0:14652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078d82c expref: 11 pid: 14211 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219960.209990:0:14652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14652:1871938465128192:0@lo:104: 00000100:00100000:0.0:1785219960.210053:0:14652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219960.210107:0:14652:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3506eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1785219960.210205:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465128192 00000100:00100000:2.0:1785219960.210214:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465128192 00000100:00100000:2.0:1785219960.210259:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219960.210270:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+3:14652:x1871938465128192:12345-0@lo:104: 00010000:00010000:2.0:1785219960.210283:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.210354:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785219960.210360:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+3:14652:x1871938465128192:12345-0@lo:104: Request processed in 93us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219960.210397:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785219960.211920:0:14652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14652:1871938465128192:0@lo:104: 00010000:00010000:1.0:1785219960.211951:0:14652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214015:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219960.214032:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214046:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28600 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:2.0:1785219960.214052:0:14207:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214062:0:14207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785219960.214069:0:14207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219960.214075:0:14207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785219960.214146:0:14207:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214154:0:14207:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785219960.214189:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214196:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf348a28600/0x8b38d407a078d82c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d833 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214217:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219960.214218:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219960.214220:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219960.214230:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785219960.214272:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465128320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785219960.214387:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219960.214446:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465128320 00000100:00100000:2.0:1785219960.214454:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465128320 00010000:00010000:2.0:1785219960.214660:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d82c expref: 12 pid: 14211 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219960.214744:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785219960.214753:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+12:3308:x1871938465128320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219960.214767:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219960.214772:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d82c expref: 12 pid: 14211 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214783:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078d82c expref: 12 pid: 14211 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214797:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3489b0400/0x8b38d407a078d833 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078d82c expref: 12 pid: 14211 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214812:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214819:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214833:0:14204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214839:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214856:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214862:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214868:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219960.214872:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214879:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214894:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.214904:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219960.214942:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+11:3308:x1871938465128320:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219960.214949:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785219960.215354:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465128320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785219960.217712:0:14652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219960.218001:0:14652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219960.218009:0:14652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3489b1c00/0x8b38d407a078d872 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219960.685558:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219961.269500:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785219951/real 1785219951] req@ffff9cf349c62d80 x1871938465125376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219961.269532:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf349c62d80 x1871938465125376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219961.269543:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785219951/real 1785219951] req@ffff9cf349c62a00 x1871938465125248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219961.269554:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf349c62a00 x1871938465125248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1785219961.269572:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785219961.269912:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1785219961.269919:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465125376:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1785219961.269926:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785219961.269937:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1785219961.269941:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465125248:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1785219961.270017:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219961.270020:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1785219961.270023:0:475:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785219961.270028:0:475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1785219961.270032:0:475:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1785219961.270039:0:475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf2462f3800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1785219961.270057:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf3506c7800 x1871938465128576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785219961.270068:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219961.270070:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1785219961.270072:0:475:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785219961.270074:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1785219961.270076:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1785219961.270079:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf342ddf000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:1.0:1785219961.270087:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf3506c6a00 x1871938465128704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785219961.270113:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465128576:0@lo:8:kworker.0 00000400:00000100:1.0:1785219961.270158:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871938465128576 offset 0 length 520: 4 00000100:00100000:1.0:1785219961.270196:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465128704:0@lo:8:kworker.0 00000400:00000100:1.0:1785219961.270211:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871938465128704 offset 0 length 520: 4 00000100:00100000:2.0:1785219961.270260:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465128448:0@lo:400:kworker.0 00000100:00100000:2.0:1785219961.270299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219961.270339:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219961.270344:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465128832:0@lo:400:kworker.0 00000100:00100000:2.0:1785219961.270397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219961.270407:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465128448 00000100:00100000:3.0:1785219961.270415:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465128448 00000100:00100000:3.0:1785219961.270474:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785219961.270714:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+11:3306:x1871938465128448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219961.270773:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+11:3306:x1871938465128448:12345-0@lo:400:kworker.0 Request processed in 291us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219961.270781:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785219961.270822:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465128832 00000100:00100000:3.0:1785219961.270826:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465128832 00000100:00100000:3.0:1785219961.270859:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219961.270865:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465128832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219961.270897:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465128832:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219961.270903:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1785219961.271570:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf3506c7100 x1871938465128832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219961.271597:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465128832:0@lo:400:kworker.0 00000100:00100000:2.0:1785219961.271610:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465128448:0@lo:400:kworker.0 10000000:01000000:1.0:1785219961.324413:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785219961.324420:0:14216:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf356ac9800 from 10 10000000:01000000:1.0:1785219961.324437:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785219961.324490:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219961.324503:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219961.324528:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219961.324562:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465128960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785219961.324635:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219961.324676:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5900 going to sleep for 11 seconds 00000100:00100000:0.0:1785219961.325715:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465128960 00000100:00100000:0.0:1785219961.325724:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465128960 00000100:00100000:0.0:1785219961.325774:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785219961.325784:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+11:14216:x1871938465128960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219961.325799:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219961.325815:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d879 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219961.325838:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d879 expref: 12 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219961.325848:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d879 expref: 12 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219961.325865:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1000, rc 0) 00000100:00100000:0.0:1785219961.325924:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465128960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219961.325931:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785219961.325994:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465128960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219961.326014:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219961.326023:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219961.326091:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465129088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219961.326121:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219961.326140:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf348731480 going to sleep for 11 seconds 00000100:00100000:0.0:1785219961.326156:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129088 00000100:00100000:0.0:1785219961.326160:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129088 00000100:00100000:0.0:1785219961.326180:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785219961.326186:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465129088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219961.326439:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465129088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219961.326447:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785219961.326455:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465129088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219961.326490:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465129216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219961.326597:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219961.326663:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219961.330010:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129216 00000100:00100000:0.0:1785219961.330021:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129216 00000100:00100000:0.0:1785219961.330073:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785219961.330083:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465129216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219961.330316:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+12:14216:x1871938465129216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219961.330323:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785219961.330425:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465129216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1785219961.342170:0:14703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1785219961.342307:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1785219961.342340:0:14216:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785219961.342351:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219961.342377:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219961.707637:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219962.735644:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219963.770123:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785219964.268016:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1785219964.449304:0:14852:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1785219964.449317:0:14852:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1785219964.449474:0:14852:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9cf3486ee000 00000020:01000004:0.0:1785219964.449490:0:14852:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1785219964.449503:0:14852:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1785219964.449516:0:14852:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cf348068000) 00000020:00000080:0.0:1785219964.449534:0:14852:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1785219964.466046:0:14852:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1785219964.466330:0:14852:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1785219964.467185:0:14852:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1785219964.467756:0:14852:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1785219964.468019:0:14852:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1785219964.468467:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 415: rc = 0 00100000:10000000:1.0:1785219964.468817:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 415: rc = 0 00100000:10000000:1.0:1785219964.468911:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 415: rc = 0 00100000:10000000:1.0:1785219964.469502:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 244: rc = 0 00100000:10000000:1.0:1785219964.469844:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 244: rc = 0 00100000:10000000:1.0:1785219964.470097:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 244: rc = 0 00100000:10000000:1.0:1785219964.470476:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 244: rc = 0 00100000:10000000:1.0:1785219964.470831:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 244: rc = 0 00100000:10000000:1.0:1785219964.471072:0:14852:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 244: rc = 0 00000020:00000080:1.0:1785219964.471737:0:14852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1785219964.471750:0:14852:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1785219964.471769:0:14852:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8b38d407a078d88e 00000020:01000004:1.0:1785219964.471778:0:14852:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1785219964.471797:0:14852:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1785219964.471800:0:14852:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1785219964.471806:0:14852:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1785219964.471810:0:14852:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1785219964.471822:0:14852:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cf34866b380) 00000020:00000080:1.0:1785219964.471831:0:14852:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1785219964.475431:0:14852:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219964.475610:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1785219964.475617:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1785219964.477331:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1785219964.477343:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1785219964.482058:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1785219964.482073:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1785219964.485565:0:14852:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785219964.485818:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1785219964.485825:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1785219964.486536:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1785219964.486543:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1785219964.506051:0:14852:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219964.506344:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1785219964.506352:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1785219964.509174:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1785219964.509188:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1785219964.519985:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785219964.520000:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1785219964.522531:0:14852:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785219964.522716:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1785219964.522723:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1785219964.525083:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1785219964.525095:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1785219964.560781:0:14852:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785219964.561004:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1785219964.561014:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1785219964.562288:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1785219964.562298:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1785219964.562929:0:14852:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1785219964.562952:0:14852:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1785219964.562959:0:14852:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1785219964.572162:0:14852:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785219964.572201:0:14852:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.131@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1785219964.572206:0:14852:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785219964.572208:0:14852:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785219964.572209:0:14852:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219964.572210:0:14852:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219964.572211:0:14852:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219964.572212:0:14852:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219964.572214:0:14852:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785219964.572216:0:14852:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219964.572222:0:14852:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785219964.572226:0:14852:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1785219964.572228:0:14852:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785219964.572229:0:14852:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785219964.572230:0:14852:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219964.572231:0:14852:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219964.572232:0:14852:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219964.572233:0:14852:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219964.572234:0:14852:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785219964.572235:0:14852:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219964.572236:0:14852:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785219964.572271:0:14852:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1785219964.572291:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1785219964.572579:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219964.572764:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7540 going to sleep for 11 seconds 00000100:00100000:2.0:1785219964.572812:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129344 00000100:00100000:2.0:1785219964.572820:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129344 00000100:00100000:2.0:1785219964.572911:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1785219964.572920:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14852:x1871938465129344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785219964.572951:0:14211:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1785219964.572954:0:14211:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1785219964.572958:0:14211:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1785219964.582924:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129344:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1785219964.582942:0:14852:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1785219964.582945:0:14852:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785219964.582947:0:14852:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785219964.582948:0:14852:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785219964.582950:0:14852:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785219964.582951:0:14852:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785219964.582952:0:14852:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785219964.582954:0:14852:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785219964.582956:0:14852:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785219964.582957:0:14852:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785219964.582982:0:14852:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf3486ee000 from lustre-OST0000 10000000:01000000:1.0:1785219964.583011:0:14852:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1785219964.583014:0:14852:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1785219964.583021:0:14852:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf34806b380 local copy 00010000:00010000:1.0:1785219964.583031:0:14852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219964.583249:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219964.583580:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.583720:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219964.583836:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14852:x1871938465129344:12345-0@lo:253:mount.lustre.0 Request processed in 10915us (11255us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.583847:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785219964.583881:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129472 00000100:00100000:0.0:1785219964.583887:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129472 00000100:00100000:2.0:1785219964.583995:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1785219964.584006:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14852:x1871938465129472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219964.584208:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+12:14852:x1871938465129472:12345-0@lo:501:mount.lustre.0 Request processed in 204us (628us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785219964.584221:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785219964.584313:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129472:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1785219964.584332:0:14852:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1785219964.584582:0:14852:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1785219964.584590:0:14852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.584599:0:14852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219964.584625:0:14852:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf3486ee000 10000000:01000000:1.0:1785219964.584630:0:14852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785219964.584776:0:14852:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cf34806b380 10000000:01000000:1.0:1785219964.584780:0:14852:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1785219964.584782:0:14852:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9cf34806b380 from 1 10000000:01000000:1.0:1785219964.584785:0:14852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1785219964.584878:0:14852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29400/0x8b38d407a078d89c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.584887:0:14852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a29400/0x8b38d407a078d89c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.584896:0:14852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a29400/0x8b38d407a078d89c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219964.584913:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785219964.584948:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.585043:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219964.585116:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129600 00000100:00100000:0.0:1785219964.585121:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129600 00000100:00100000:0.0:1785219964.585145:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785219964.585152:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+12:14852:x1871938465129600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785219964.585162:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219964.585176:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b1200/0x8b38d407a078d8a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d89c expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.585210:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b1200/0x8b38d407a078d8a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d89c expref: 13 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.585221:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b1200/0x8b38d407a078d8a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d89c expref: 13 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.585230:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1200, rc 0) 00000100:00100000:0.0:1785219964.585269:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+13:14852:x1871938465129600:12345-0@lo:101:mount.lustre.0 Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.585275:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785219964.585497:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219964.585530:0:14852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a29400/0x8b38d407a078d89c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8a3 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.585540:0:14852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a29400/0x8b38d407a078d89c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d8a3 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219964.585557:0:14852:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1785219964.585567:0:14852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29400/0x8b38d407a078d89c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8a3 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.585574:0:14852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a29400/0x8b38d407a078d89c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8a3 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219964.585581:0:14852:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1785219964.585584:0:14852:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785219964.585589:0:14852:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1785219964.585591:0:14852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1785219964.585606:0:14852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28c00/0x8b38d407a078d8aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.585612:0:14852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a28c00/0x8b38d407a078d8aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.585619:0:14852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a28c00/0x8b38d407a078d8aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219964.585754:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785219964.585785:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.585805:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219964.585943:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129728 00000100:00100000:2.0:1785219964.585948:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129728 00000100:00100000:2.0:1785219964.585972:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1785219964.585978:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+13:14852:x1871938465129728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219964.585986:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219964.585995:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf37edc9600/0x8b38d407a078d8b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d8aa expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219964.586011:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf37edc9600/0x8b38d407a078d8b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d8aa expref: 14 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219964.586018:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf37edc9600/0x8b38d407a078d8b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d8aa expref: 14 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219964.586025:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9600, rc 0) 00000100:00100000:2.0:1785219964.586064:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465129728:12345-0@lo:101:mount.lustre.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219964.586070:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785219964.586906:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219964.586925:0:14852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a28c00/0x8b38d407a078d8aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8b1 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.586934:0:14852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a28c00/0x8b38d407a078d8aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d8b1 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785219964.588030:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1785219964.592974:0:14852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219964.593278:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1785219964.593338:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1785219964.593546:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1785219964.593599:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1785219964.593717:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1785219964.593755:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1785219964.593901:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1785219964.593911:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1785219964.594016:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219964.594094:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.594146:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219964.594231:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129856 00000100:00100000:2.0:1785219964.594239:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129856 00000100:00100000:2.0:1785219964.594341:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785219964.594361:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465129856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219964.594760:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465129856:12345-0@lo:501:mount.lustre.0 Request processed in 409us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219964.594768:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785219964.595002:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219964.595041:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219964.595084:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.595743:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219964.595899:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465129984 00000100:00100000:0.0:1785219964.595906:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465129984 00000100:00100000:0.0:1785219964.595943:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785219964.595952:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465129984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785219964.596301:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465129984:12345-0@lo:503:mount.lustre.0 Request processed in 349us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.596318:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785219964.596503:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465129984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785219964.597262:0:14852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785219964.597343:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219964.597445:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.597474:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219964.597600:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465130112 00000100:00100000:0.0:1785219964.597606:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465130112 00000100:00100000:0.0:1785219964.597646:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785219964.597654:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465130112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785219964.598004:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465130112:12345-0@lo:502:mount.lustre.0 Request processed in 349us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.598012:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785219964.598175:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785219964.598464:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1785219964.598527:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1785219964.598562:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1785219964.598611:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1785219964.598891:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1785219964.598929:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1785219964.598976:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1785219964.599013:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1785219964.599047:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1785219964.599089:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1785219964.599119:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1785219964.599160:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1785219964.599197:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219964.599249:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.599361:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219964.599538:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465130240 00000100:00100000:3.0:1785219964.599545:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465130240 00000100:00100000:0.0:1785219964.599723:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785219964.599734:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465130240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785219964.600004:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465130240:12345-0@lo:502:mount.lustre.0 Request processed in 272us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.600013:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785219964.600114:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785219964.600199:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1785219964.600210:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1785219964.601435:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1785219964.601450:0:14866:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1785219964.601457:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219964.601460:0:14866:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1785219964.601465:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785219964.601481:0:14866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cf245228000) 00000020:00000080:2.0:1785219964.601502:0:14866:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1785219964.601509:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785219964.601572:0:14866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf3486ee000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1785219964.601582:0:14866:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785219964.601588:0:14866:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8b38d407a078d8bf 00010000:00010000:2.0:1785219964.609070:0:14866:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1785219964.609803:0:14866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1785219964.612991:0:14866:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1785219964.627930:0:14866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1785219964.627943:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219964.627950:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219964.627952:0:14866:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1785219964.627956:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1785219964.627959:0:14866:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1785219964.627960:0:14866:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1785219964.627962:0:14866:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1785219964.627963:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1785219964.627965:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219964.627966:0:14866:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1785219964.627969:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785219964.627971:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219964.627973:0:14866:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1785219964.627975:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1785219964.627977:0:14866:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1785219964.627979:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219964.627981:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219964.627982:0:14866:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1785219964.627984:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785219964.627986:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219964.627994:0:14866:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1785219964.627998:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1785219964.628066:0:14866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785219964.628070:0:14866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219964.628071:0:14866:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1785219964.628074:0:14866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1785219964.632650:0:14852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1785219964.632690:0:14852:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1785219964.632717:0:14852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28c00/0x8b38d407a078d8aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8b1 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.632729:0:14852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a28c00/0x8b38d407a078d8aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8b1 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219964.632750:0:14852:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf3486ee000 from 1 10000000:01000000:1.0:1785219964.632753:0:14852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785219964.632796:0:14852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.632803:0:14852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.632824:0:14852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219964.632852:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785219964.632925:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.632972:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785219964.634536:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465130368 00000100:00100000:3.0:1785219964.634552:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465130368 00000100:00100000:3.0:1785219964.634651:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785219964.634660:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+14:14852:x1871938465130368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219964.634676:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219964.634695:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d8c6 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219964.634725:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 15 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219964.634735:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 15 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219964.634745:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07600, rc 0) 00000100:00100000:3.0:1785219964.634814:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130368:12345-0@lo:101:mount.lustre.0 Request processed in 155us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219964.634833:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785219964.634937:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219964.634955:0:14852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.634964:0:14852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785219964.635636:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1785219964.635943:0:14852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219964.636210:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1785219964.636256:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1785219964.636340:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1785219964.636360:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1785219964.636456:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219964.636515:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.638273:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785219964.638603:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465130496 00000100:00100000:2.0:1785219964.638612:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465130496 00000100:00100000:2.0:1785219964.638672:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785219964.638691:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219964.639127:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130496:12345-0@lo:501:mount.lustre.0 Request processed in 436us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219964.639137:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1785219964.639266:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785219964.639332:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785219964.639403:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219964.639430:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3411ca240 going to sleep for 11 seconds 00000100:00100000:3.0:1785219964.639571:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465130624 00000100:00100000:3.0:1785219964.639577:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465130624 00000100:00100000:3.0:1785219964.639606:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785219964.639613:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785219964.639815:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130624:12345-0@lo:503:mount.lustre.0 Request processed in 201us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219964.639824:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785219964.639932:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130624:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1785219964.641047:0:14852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785219964.641123:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785219964.641302:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219964.641529:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf344ce23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219964.641827:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465130752 00000100:00100000:3.0:1785219964.641835:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465130752 00000100:00100000:3.0:1785219964.641923:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785219964.641933:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785219964.642140:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130752:12345-0@lo:502:mount.lustre.0 Request processed in 209us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219964.642148:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785219964.642228:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785219964.642569:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1785219964.642625:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1785219964.642690:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1785219964.642730:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1785219964.642764:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1785219964.642818:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1785219964.642851:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1785219964.642877:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1785219964.642907:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219964.642954:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.643254:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219964.643316:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465130880 00000100:00100000:0.0:1785219964.643322:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465130880 00000100:00100000:0.0:1785219964.643353:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785219964.643359:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785219964.643608:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465130880:12345-0@lo:502:mount.lustre.0 Request processed in 248us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.643616:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785219964.643808:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465130880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785219964.643912:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1785219964.643926:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1785219964.644837:0:14870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219964.644850:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219964.644852:0:14870:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1785219964.644861:0:14870:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf3486ee000 00000020:00000080:3.0:1785219964.644864:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785219964.644871:0:14870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219964.644873:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219964.644874:0:14870:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1785219964.644876:0:14870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219964.644878:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219964.644879:0:14870:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1785219964.644882:0:14870:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf3486ee000 00000020:00000080:3.0:1785219964.644884:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785219964.644939:0:14870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219964.644943:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219964.644944:0:14870:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1785219964.644947:0:14870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785219964.644950:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219964.644951:0:14870:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785219964.644955:0:14870:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf3486ee000 00000020:00000080:3.0:1785219964.644967:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785219964.645007:0:14870:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785219964.645011:0:14870:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785219964.645012:0:14870:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785219964.645016:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1785219964.646451:0:14852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1785219964.646487:0:14852:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785219964.646509:0:14852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.646522:0:14852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219964.646566:0:14852:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1785219964.646569:0:14852:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf3486ee000 10000000:01000000:1.0:1785219964.646572:0:14852:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf3486ee000 10000000:01000000:1.0:1785219964.646583:0:14852:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785219964.646589:0:14852:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf3486ee000 from 1 10000000:01000000:1.0:1785219964.646592:0:14852:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785219964.646630:0:14852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28000/0x8b38d407a078d8d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.646714:0:14852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf348a28000/0x8b38d407a078d8d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.646726:0:14852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf348a28000/0x8b38d407a078d8d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219964.646753:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785219964.646818:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.646856:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7480 going to sleep for 11 seconds 00000100:00100000:2.0:1785219964.647433:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131008 00000100:00100000:2.0:1785219964.647442:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131008 00000100:00100000:1.0:1785219964.647593:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1785219964.647602:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465131008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219964.647616:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219964.647631:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf348a28600/0x8b38d407a078d8db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d8d4 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.647667:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf348a28600/0x8b38d407a078d8db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d8d4 expref: 16 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.647676:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf348a28600/0x8b38d407a078d8db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d8d4 expref: 16 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.647684:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf348a28600, rc 0) 00000100:00100000:1.0:1785219964.647740:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131008:12345-0@lo:101:mount.lustre.0 Request processed in 138us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219964.647758:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1785219964.647833:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219964.647849:0:14852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf348a28000/0x8b38d407a078d8d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8db expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219964.647859:0:14852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf348a28000/0x8b38d407a078d8d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d8db expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785219964.648527:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1785219964.648880:0:14852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785219964.649129:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1785219964.649172:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1785219964.649203:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1785219964.649246:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1785219964.649282:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1785219964.649344:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1785219964.649429:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1785219964.649465:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1785219964.649521:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1785219964.649561:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1785219964.649615:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1785219964.649669:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1785219964.649707:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1785219964.649746:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1785219964.649797:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1785219964.649835:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1785219964.649872:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1785219964.649938:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1785219964.649978:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1785219964.650015:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1785219964.650063:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1785219964.650094:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1785219964.650124:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1785219964.650171:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1785219964.650207:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1785219964.650242:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1785219964.650314:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1785219964.650352:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1785219964.650457:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1785219964.650465:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1785219964.650551:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219964.650608:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219964.653818:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350320cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219964.653867:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131136 00000100:00100000:3.0:1785219964.653877:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131136 00000100:00100000:3.0:1785219964.653928:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785219964.653938:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785219964.654291:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131136:12345-0@lo:501:mount.lustre.0 Request processed in 354us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219964.654298:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785219964.657492:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219964.657553:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785219964.657627:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219964.657771:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350320cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219964.657827:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131264 00000100:00100000:1.0:1785219964.657833:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131264 00000100:00100000:1.0:1785219964.657881:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785219964.657889:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219964.658066:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131264:12345-0@lo:503:mount.lustre.0 Request processed in 177us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219964.658074:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785219964.658156:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131264:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785219964.661164:0:14852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785219964.661264:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785219964.661354:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219964.661416:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350320cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219964.661510:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131392 00000100:00100000:1.0:1785219964.661517:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131392 00000100:00100000:1.0:1785219964.661558:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785219964.661579:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219964.661801:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131392:12345-0@lo:502:mount.lustre.0 Request processed in 235us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219964.661809:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785219964.664807:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785219964.665139:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1785219964.665207:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1785219964.665261:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1785219964.665325:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1785219964.665384:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1785219964.665452:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1785219964.665493:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1785219964.665528:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1785219964.665578:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1785219964.665614:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1785219964.665945:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1785219964.666000:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1785219964.666040:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1785219964.666074:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1785219964.666136:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1785219964.666179:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1785219964.666215:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1785219964.666267:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1785219964.666314:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1785219964.666352:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1785219964.666431:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1785219964.666469:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1785219964.666503:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1785219964.666565:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1785219964.666602:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1785219964.666637:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1785219964.667962:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1785219964.668001:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1785219964.668034:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1785219964.668085:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1785219964.668122:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1785219964.668158:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1785219964.668195:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1785219964.668245:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1785219964.668281:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1785219964.668344:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1785219964.671565:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1785219964.671620:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1785219964.673839:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1785219964.673925:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1785219964.673978:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785219964.674057:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219964.677842:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350320cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785219964.683475:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131520 00000100:00100000:3.0:1785219964.683491:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131520 00000100:00100000:3.0:1785219964.683574:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785219964.683584:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785219964.683876:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131520:12345-0@lo:502:mount.lustre.0 Request processed in 292us (9818us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219964.683884:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785219964.683995:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785219964.684114:0:14852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1785219964.684129:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1785219964.688010:0:14875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1785219964.688026:0:14875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cf349c54d40) 00000020:00000080:3.0:1785219964.688050:0:14875:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1785219964.688214:0:14875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf3486ee000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1785219964.688220:0:14875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf3486ee000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1785219964.688222:0:14875:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf3486ee000 3 00010000:00080000:3.0:1785219964.688252:0:14875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf36cda4800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.131@tcp at head 00010000:00010000:3.0:1785219964.689881:0:14875:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1785219964.689984:0:14875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1785219964.690021:0:14875:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785219964.690038:0:14875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8b38d407a078d8e9 00000100:00080000:3.0:1785219964.690048:0:14875:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785219964.690053:0:14875:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cf36cda4800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1785219964.690093:0:14875:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf381a2a680 x1871938465131648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785219964.690119:0:14875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1785219964.690155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785219964.690160:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1785219964.690163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785219964.690166:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1785219964.690223:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465131776:0@lo:400:kworker.0 00000100:00100000:3.0:1785219964.690295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219964.690356:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131776 00000100:00100000:3.0:1785219964.690382:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131776 00000100:00100000:3.0:1785219964.690426:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785219964.690434:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465131776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219964.690478:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465131776:12345-0@lo:400:kworker.0 Request processed in 44us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219964.690484:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785219964.690517:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf381a28380 x1871938465131776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219964.690529:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465131776:0@lo:400:kworker.0 00000100:00100000:1.0:1785219964.692427:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465131648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1785219964.692495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.692568:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131648 00000100:00100000:1.0:1785219964.692575:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131648 00000100:00100000:1.0:1785219964.692605:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219964.692612:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1871938465131648:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1785219964.692636:0:14221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:1.0:1785219964.692668:0:14221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8b38d407a078d8f0 00000004:00100000:1.0:1785219964.692680:0:14221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1785219964.692709:0:14221:0:(import.c:65:import_set_state_nolock()) ffff9cf3429c8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219964.692762:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871938465131648:12345-0@lo:38:llog_process_th.0 Request processed in 148us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219964.692768:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1785219964.692804:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf381a2a680 x1871938465131648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785219974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785219964.692814:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785219964.692820:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1785219964.692827:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1785219964.692830:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1785219964.692832:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf36cda4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1785219964.692837:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1871938465131648:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1785219964.697628:0:14875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1785219964.702112:0:14852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1785219964.702198:0:14852:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785219964.702220:0:14852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28000/0x8b38d407a078d8d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8db expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219964.702233:0:14852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a28000/0x8b38d407a078d8d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d8db expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1785219964.702348:0:14852:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1785219964.702350:0:14852:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785219964.702352:0:14852:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219964.702353:0:14852:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785219964.702354:0:14852:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219964.702355:0:14852:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219964.702356:0:14852:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219964.702358:0:14852:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219964.702359:0:14852:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785219964.702753:0:14852:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1785219964.702757:0:14852:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785219964.702759:0:14852:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785219964.702760:0:14852:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219964.702761:0:14852:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785219964.702762:0:14852:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219964.702763:0:14852:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219964.702764:0:14852:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219964.702766:0:14852:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219964.702767:0:14852:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785219964.702795:0:14852:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1785219964.702817:0:14852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1785219964.702891:0:14852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219964.702968:0:14852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350320cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219964.703219:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465131904 00000100:00100000:1.0:1785219964.703228:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465131904 00000100:00100000:1.0:1785219964.711413:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1785219964.711439:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:14852:x1871938465131904:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1785219964.711477:0:14211:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1785219964.711494:0:14211:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1785219964.775034:0:14211:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1785219964.775064:0:14211:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1785219964.775211:0:14235:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785219964.775216:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785219964.775238:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.775257:0:14235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d85d expref: 16 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.775266:0:14235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.775314:0:14235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078d85d expref: 16 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219964.775339:0:14235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078d85d expref: 16 pid: 14214 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219964.775458:0:14235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1871938465132032:0@lo:104: 00000100:00100000:1.0:1785219964.775522:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219964.775565:0:14235:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3672f7480 going to sleep for 11 seconds 00000100:00100000:0.0:1785219964.775780:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132032 00000100:00100000:0.0:1785219964.775788:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132032 00000100:00100000:0.0:1785219964.775909:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785219964.775919:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+3:14235:x1871938465132032:12345-0@lo:104: 00010000:00010000:0.0:1785219964.775931:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.775994:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785219964.776001:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+3:14235:x1871938465132032:12345-0@lo:104: Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.776008:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1785219964.776031:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219964.776037:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.776045:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07e00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:0.0:1785219964.776049:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219964.776171:0:14235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1871938465132032:0@lo:104: 00010000:00010000:3.0:1785219964.776191:0:14235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.776257:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785219964.776264:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785219964.776270:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1785219964.776314:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.776321:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785219964.776342:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.776447:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f07e00/0x8b38d407a078d85d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d864 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.776469:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219964.776471:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219964.776473:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219964.776489:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465132160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785219964.776533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219964.776623:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132160 00000100:00100000:0.0:1785219964.776628:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132160 00010000:00010000:0.0:1785219964.776654:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d85d expref: 17 pid: 14214 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219964.776936:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785219964.776948:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19240113-729d-48ac-b4dd-0e1109961383+17:3309:x1871938465132160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785219964.776967:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785219964.776975:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d85d expref: 17 pid: 14214 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.776988:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078d85d expref: 17 pid: 14214 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777003:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf348a29a00/0x8b38d407a078d864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078d85d expref: 17 pid: 14214 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777020:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777029:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1785219964.777044:0:14206:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001828349s 00010000:00010000:0.0:1785219964.777049:0:14206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777253:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777261:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777268:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777274:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219964.777278:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777294:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219964.777573:0:14235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219964.777583:0:14235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777920:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777933:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf348a29000/0x8b38d407a078d8f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219964.777959:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785219964.778520:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19240113-729d-48ac-b4dd-0e1109961383+16:3309:x1871938465132160:12345-0@lo:103:ldlm_bl.0 Request processed in 1572us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219964.778531:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219964.778775:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465132160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785219964.779957:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219964.807398:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+15:14852:x1871938465131904:12345-0@lo:253:mount.lustre.0 Request processed in 95924us (104458us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219964.807421:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1785219964.809546:0:14852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:14852:1871938465131904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1785219964.809574:0:14852:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1785219964.809579:0:14852:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785219964.809581:0:14852:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785219964.809582:0:14852:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785219964.809584:0:14852:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785219964.809586:0:14852:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785219964.809587:0:14852:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785219964.809589:0:14852:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785219964.809591:0:14852:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785219964.809593:0:14852:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1785219964.809615:0:14852:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1785219964.826460:0:14852:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1785219964.826784:0:14852:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1785219964.826963:0:14852:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1785219964.827472:0:14852:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1785219964.833868:0:14852:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1785219964.836049:0:14852:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1785219964.837774:0:14852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1785219964.887650:0:14852:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1785219964.887663:0:14852:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1785219964.887709:0:14852:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1785219964.887783:0:14852:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1785219964.887801:0:14852:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1785219964.887841:0:14852:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1785219965.804697:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785219966.443570:0:14216:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1785219966.443579:0:14216:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf356ac9800 from 7 10000000:01000000:3.0:1785219966.443584:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1785219966.443637:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219966.443650:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219966.443662:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219966.443688:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465132288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785219966.443757:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219966.443842:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997780 going to sleep for 11 seconds 00000100:00100000:2.0:1785219966.444265:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132288 00000100:00100000:2.0:1785219966.444275:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132288 00000100:00100000:2.0:1785219966.444343:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785219966.444352:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+15:14216:x1871938465132288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219966.444396:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219966.444426:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d8fe expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219966.444451:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 16 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219966.444462:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 16 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219966.444472:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8600, rc 0) 00000100:00100000:2.0:1785219966.444520:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:14216:x1871938465132288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219966.444527:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1785219966.444624:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465132288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219966.444640:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219966.444658:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219966.444708:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465132416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1785219966.444741:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219966.444772:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785219966.444901:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132416 00000100:00100000:3.0:1785219966.444906:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132416 00000100:00100000:3.0:1785219966.444978:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785219966.444986:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+16:14216:x1871938465132416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1785219966.445002:0:14214:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1785219966.445018:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1785219966.445021:0:14214:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1785219966.445106:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+16:14216:x1871938465132416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219966.445116:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1785219966.445173:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465132416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1785219966.445226:0:14216:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785219966.445233:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219966.445241:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219966.832085:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219967.852065:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219968.888382:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219969.899499:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785219969.969214:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219969.969221:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785219969.969223:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219969.969226:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1785219969.969265:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785219969.969295:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465132800:0@lo:400:kworker.0 00000100:00100000:1.0:1785219969.969377:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219969.969492:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132800 00000100:00100000:3.0:1785219969.969499:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132800 00000100:00100000:3.0:1785219969.969561:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785219969.969569:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465132800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219969.969626:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465132800:12345-0@lo:400:kworker.0 Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219969.969634:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1785219969.969677:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf3506c7480 x1871938465132800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219969.969690:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465132800:0@lo:400:kworker.0 00000100:00080000:1.0:1785219969.972390:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219969.977234:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465132544:0@lo:400:kworker.0 00000100:00100000:2.0:1785219969.977316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219969.977374:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219969.977381:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465132672:0@lo:400:kworker.0 00000100:00100000:2.0:1785219969.977403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219969.977444:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132672 00000100:00100000:2.0:1785219969.977451:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132672 00000100:00100000:2.0:1785219969.977487:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785219969.977495:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465132672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219969.977566:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465132672:12345-0@lo:400:kworker.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219969.977573:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785219969.977793:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132544 00000100:00100000:1.0:1785219969.977798:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132544 00000100:00100000:1.0:1785219969.977839:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1785219969.977846:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:3306:x1871938465132544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219969.977882:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:3306:x1871938465132544:12345-0@lo:400:kworker.0 Request processed in 37us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219969.977888:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1785219969.978026:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf3506c5180 x1871938465132672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219969.978041:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465132672:0@lo:400:kworker.0 00000100:00100000:2.0:1785219969.978068:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465132544:0@lo:400:kworker.0 00010000:00010000:2.0:1785219970.924721:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785219971.279031:0:15220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1785219971.948515:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219972.975901:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219974.004760:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785219974.509134:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785219975.020627:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785219975.086591:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219975.086599:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785219975.086602:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785219975.086605:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1785219975.086649:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465132928:0@lo:400:kworker.0 00000100:00100000:1.0:1785219975.086740:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219975.087092:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465133056:0@lo:400:kworker.0 00000100:00100000:2.0:1785219975.087130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219975.087162:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219975.087169:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465133184:0@lo:400:kworker.0 00000100:00100000:2.0:1785219975.087194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219975.087225:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465132928 00000100:00100000:2.0:1785219975.087243:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465132928 00000100:00100000:2.0:1785219975.087290:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785219975.087299:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:3309:x1871938465132928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219975.087353:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:3309:x1871938465132928:12345-0@lo:400:kworker.0 Request processed in 55us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219975.087360:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785219975.087439:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133056 00000100:00100000:2.0:1785219975.087443:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133056 00000100:00100000:2.0:1785219975.087466:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133184 00000100:00100000:2.0:1785219975.087469:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133184 00000100:00100000:2.0:1785219975.087493:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785219975.087499:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465133056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219975.087548:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465133056:12345-0@lo:400:kworker.0 Request processed in 48us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219975.087554:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785219975.087567:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219975.087583:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465133184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219975.087625:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465133184:12345-0@lo:400:kworker.0 Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219975.087630:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219975.087882:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465132928:0@lo:400:kworker.0 00000100:00080000:2.0:1785219975.087910:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785219975.087931:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf3506c4700 x1871938465133184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219975.087942:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465133184:0@lo:400:kworker.0 00010000:00080000:2.0:1785219975.087952:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf3506c4380 x1871938465133056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785219975.087960:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465133056:0@lo:400:kworker.0 00010000:00010000:1.0:1785219976.043532:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219976.941420:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785219961/real 1785219961] req@ffff9cf3506c7800 x1871938465128576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219976.941456:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf3506c7800 x1871938465128576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219976.941465:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785219961/real 1785219961] req@ffff9cf3506c6a00 x1871938465128704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219976.941476:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf3506c6a00 x1871938465128704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785219976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1785219976.941506:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785219976.941529:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1785219976.941533:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465128576:0@lo:8:kworker.0 00000100:00080000:0.0:1785219976.941539:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785219976.941543:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1785219976.941546:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465128704:0@lo:8:kworker.0 00000100:00080000:0.0:1785219976.941610:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785219976.941614:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1785219976.941616:0:475:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785219976.941620:0:475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1785219976.941625:0:475:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1785219976.941632:0:475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf2462f3800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219976.941652:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf349c60380 x1871938465133440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785219976.941664:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785219976.941667:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1785219976.941669:0:475:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785219976.941671:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1785219976.941674:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1785219976.941677:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf342ddf000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219976.941685:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf349c63800 x1871938465133568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785219976.941729:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465133312:0@lo:400:kworker.0 00000100:00100000:0.0:1785219976.943306:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219976.943394:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785219976.943405:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465133696:0@lo:400:kworker.0 00000100:00100000:0.0:1785219976.943440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219976.943481:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465133440:0@lo:8:kworker.0 00000100:00100000:0.0:1785219976.943514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219976.943545:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465133568:0@lo:8:kworker.0 00000100:00100000:0.0:1785219976.943572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219976.943580:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133440 00000100:00100000:3.0:1785219976.943591:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133440 00000100:00100000:0.0:1785219976.943605:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465133824:0@lo:400:kworker.0 00000100:00100000:3.0:1785219976.943623:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133568 00000100:00100000:3.0:1785219976.943628:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133568 00000100:00100000:0.0:1785219976.943637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219976.943645:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219976.943654:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1871938465133440:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1785219976.943678:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133312 00010000:00080000:3.0:1785219976.943682:0:14853:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000100:00100000:0.0:1785219976.943684:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133312 00000020:00000080:3.0:1785219976.943714:0:14853:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078d90c 00000100:00100000:0.0:1785219976.943719:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785219976.943728:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+16:3308:x1871938465133312:12345-0@lo:400:kworker.0 00002000:00100000:3.0:1785219976.943729:0:14853:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cf36cda6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cc ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1785219976.943737:0:14853:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1785219976.943740:0:14853:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1785219976.944055:0:14853:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1785219976.944080:0:14853:0:(import.c:65:import_set_state_nolock()) ffff9cf36cda1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785219976.944132:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1871938465133440:12345-0@lo:8:kworker.0 Request processed in 479us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219976.944140:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785219976.944157:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785219976.944161:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1871938465133568:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1785219976.944172:0:14853:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1785219976.944204:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1871938465133568:12345-0@lo:8:kworker.0 Request processed in 41us (632us total) trans 0 rc -19/-19 00000100:00100000:3.0:1785219976.944211:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785219976.944701:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+16:3308:x1871938465133312:12345-0@lo:400:kworker.0 Request processed in 493us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219976.944712:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785219976.944823:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133696 00000100:00100000:0.0:1785219976.944829:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133696 00000100:00100000:0.0:1785219976.944864:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133824 00000100:00100000:0.0:1785219976.944868:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133824 00000100:00100000:0.0:1785219976.944884:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219976.944891:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219976.944933:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465133696:12345-0@lo:400:kworker.0 Request processed in 42us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219976.944939:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219976.944958:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219976.944963:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465133824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219976.944994:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465133824:12345-0@lo:400:kworker.0 Request processed in 31us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219976.945000:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1785219976.945044:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf349c60380 x1871938465133440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785219996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219976.945055:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785219976.945064:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1785219976.945072:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1785219976.945078:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1785219976.945081:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf2462f3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1785219976.945100:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1785219976.945105:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465133440:0@lo:8:kworker.0 00000100:00080000:0.0:1785219976.945117:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785219976.945121:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1785219976.945124:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465133568:0@lo:8:kworker.0 00010000:00080000:0.0:1785219976.949659:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf349c61880 x1871938465133696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219976.949679:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465133696:0@lo:400:kworker.0 00000100:00100000:0.0:1785219976.949692:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465133312:0@lo:400:kworker.0 00010000:00080000:0.0:1785219976.949731:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf349c60e00 x1871938465133824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219976.949742:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465133824:0@lo:400:kworker.0 00000004:00080000:0.0:1785219976.951334:0:14242:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1785219976.951361:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1871938465134080:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1785219976.951444:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219976.951475:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf345f54180 going to sleep for 11 seconds 00000100:00100000:0.0:1785219976.951491:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465133952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219976.951516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219976.951559:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134080 00000100:00100000:0.0:1785219976.951567:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134080 00000100:00100000:0.0:1785219976.951610:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785219976.951618:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14242:x1871938465134080:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1785219976.957096:0:14241:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1785219976.958125:0:14241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 469810757414ns, next at 0ns, rc = 0 00000100:00100000:2.0:1785219976.959417:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465133952 00000100:00100000:2.0:1785219976.959435:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465133952 00000100:00100000:2.0:1785219976.959500:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785219976.959512:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465133952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785219976.959553:0:14857:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219976.959655:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871938465133952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (8137us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219976.959662:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1785219976.963763:0:14856:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1785219976.963778:0:14856:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1785219976.963784:0:14856:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:2.0:1785219976.970664:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1785219976.983758:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219976.983774:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.983796:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219976.983802:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219976.983810:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.983832:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.983844:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.983861:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.983884:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1785219976.984508:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219976.984516:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.984527:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219976.984531:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219976.984536:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.984546:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.984556:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.984563:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.984583:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1785219976.985006:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219976.985014:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.985031:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219976.985033:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219976.985038:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.985047:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.985055:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.985061:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.985070:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1785219976.986249:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219976.986260:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.986273:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219976.986278:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219976.986284:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.986296:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.986320:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.986328:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.986339:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1785219976.987316:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219976.987328:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.987343:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219976.987348:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219976.987355:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.987409:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.987419:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.987427:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.987449:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1785219976.990545:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219976.991687:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.991711:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219976.991718:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219976.991726:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.991813:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.991828:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.991837:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219976.991857:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00080000:0.0:1785219977.005907:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf349c60e00 x1871938465133952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219977.005946:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465133952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785219977.005998:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1785219977.006034:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006052:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.006058:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006072:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006101:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006109:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078d913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006135:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1785219977.006140:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006147:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.006150:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006158:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006180:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006186:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddf54e6/0x8b38d407a078d91a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006212:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1785219977.006216:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006233:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.006237:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006244:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006253:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006260:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074ad0314/0x8b38d407a078d921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006273:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785219977.006277:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006289:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.006292:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006300:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006310:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.006316:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87d4549/0x8b38d407a078d928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007498:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785219977.007505:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007514:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.007519:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007588:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007611:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007634:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d92f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007718:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.007724:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007731:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.007735:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.007742:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.008089:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.008099:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.008117:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.008119:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.008122:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.008145:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.017152:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.017188:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017211:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.017227:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.017236:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017256:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017269:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017277:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017303:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219977.017323:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.017329:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017338:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.017345:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017355:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017424:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017433:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d93d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.017462:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.017465:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.017468:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.018529:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.018541:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018557:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.018561:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.018567:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018579:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018590:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018599:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018635:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219977.018653:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.018659:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018668:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.018673:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018685:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018702:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018710:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.018738:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.018740:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.018742:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.024515:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.024535:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.024558:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.024577:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.024587:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.024607:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.024621:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.024631:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.026268:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785219977.026955:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219977.026968:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.026987:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219977.027003:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.027015:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.027048:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.027057:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078d94b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.027089:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.027091:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.027093:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.031344:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.031378:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031404:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.031411:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.031420:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031440:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031454:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031473:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.031576:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219977.031582:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.031597:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031610:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.031615:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031627:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031665:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031674:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.031701:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.031703:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.031706:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.033791:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.034048:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.034079:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.034085:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.034092:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.034110:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.034123:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.034141:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.034503:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.034514:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785219977.034519:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.034536:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219977.034542:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.034553:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.034586:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.034594:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078d959 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.034637:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219977.034640:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219977.034642:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.036631:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.036749:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.036946:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.036955:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.036965:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.036988:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037102:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037118:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037229:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219977.037258:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.037265:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037275:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.037280:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037290:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037310:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037317:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d960 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.037347:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.037360:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.037504:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.044602:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.044623:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045596:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.045612:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.045624:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045655:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045669:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045677:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045706:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219977.045729:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.045737:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045749:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.045764:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045790:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045823:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045831:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a0161c/0x8b38d407a078d967 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.045859:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.045861:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.045863:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.046738:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.046747:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.046763:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.046768:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.046774:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.046787:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.046796:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.046810:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.046839:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785219977.047134:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219977.047146:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.047158:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219977.047164:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.047175:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.047195:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.047213:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd9344b/0x8b38d407a078d96e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.047244:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.047247:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.047248:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.051565:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.051586:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051609:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.051616:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.051625:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051643:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051666:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051675:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051704:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219977.051726:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.051734:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051946:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219977.051953:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051964:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051986:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.051994:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3fac9c/0x8b38d407a078d975 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.052019:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.052023:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.052025:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785219977.063635:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785219977.063667:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.063689:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=469s v=(0 0) 00010000:00010000:0.0:1785219977.063694:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785219977.063703:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.063721:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.063741:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.063749:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.067826:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219977.067865:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219977.067880:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.067895:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219977.067914:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.067925:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.067953:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.067962:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06d37c1/0x8b38d407a078d97c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.067990:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.067991:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.067993:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.071924:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.077989:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.078006:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078026:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.078031:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.078039:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078055:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078068:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078087:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078113:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219977.078130:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219977.078135:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078143:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29200 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219977.078148:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078156:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078174:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078181:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a68efaf6/0x8b38d407a078d983 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078205:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.078207:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.078210:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.078814:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.078831:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078842:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.078846:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.078852:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078863:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078872:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078879:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.078902:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785219977.079295:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.079302:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079310:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.079313:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.079317:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079325:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079340:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079347:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079361:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1785219977.079410:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785219977.079415:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079423:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219977.079427:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079435:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079451:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079459:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afa2e6c4/0x8b38d407a078d98a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079473:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219977.079483:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079490:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219977.079493:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079501:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079512:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079519:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a69c12a/0x8b38d407a078d991 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079531:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.079533:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.079535:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.079942:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.079948:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079957:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.079960:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.079964:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079984:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.079992:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080000:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080015:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219977.080024:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219977.080028:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080034:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219977.080037:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080044:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080054:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080060:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d6b2ab0/0x8b38d407a078d998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080080:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.080081:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.080083:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.080508:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.080514:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080524:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.080527:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.080532:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080542:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080550:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080558:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080574:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219977.080583:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219977.080586:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.080604:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a28800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219977.080607:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.080709:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.082382:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.082421:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.082429:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e3287f/0x8b38d407a078d99f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.082454:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.082456:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.082458:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.085948:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.085962:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.085980:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.085984:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.085991:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.086004:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.086025:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.086033:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.086063:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219977.087112:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219977.087129:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785219977.088145:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.088158:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.088173:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.088177:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.088183:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.088196:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.088235:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219977.088236:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.088246:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.088261:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.088286:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.088295:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a07b2c6e/0x8b38d407a078d9a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.088353:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.088355:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219977.088358:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219977.089755:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.089804:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785219977.090664:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219977.090673:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.090685:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219977.090691:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.090702:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.090722:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.090740:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb90f0d6/0x8b38d407a078d9ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.090765:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.090767:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.090769:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.091015:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.091023:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.091036:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.091040:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.091047:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.091059:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.091067:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.091074:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.091106:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785219977.093843:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219977.093856:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.093870:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cd600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219977.093876:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.093888:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.093908:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.093916:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d0f9ff/0x8b38d407a078d9b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.093936:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.093938:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.093939:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.096082:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.096095:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.096113:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.096125:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.096131:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.096145:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.096156:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.096164:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.096189:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785219977.096214:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219977.096235:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.096246:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cc800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219977.096251:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.096261:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.096281:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.096289:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebea680a/0x8b38d407a078d9bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.096319:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219977.096322:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219977.096323:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219977.098346:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.098359:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.098405:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.098410:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.098416:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.098430:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.098440:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.099416:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.099445:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785219977.104726:0:14856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219977.104865:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.104882:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1785219977.104887:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219977.104893:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.104907:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.104918:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.104925:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.104953:0:14856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1785219977.105233:0:14856:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:2.0:1785219977.106505:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785219977.106518:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106530:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cca00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219977.106534:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106563:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106586:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106594:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075934b00/0x8b38d407a078d9c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106626:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219977.106630:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106637:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cce00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219977.106640:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106647:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106657:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106663:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e000d2/0x8b38d407a078d9c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.106688:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.106690:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219977.106692:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219977.106991:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14242:x1871938465134080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 155367us (155541us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219977.107014:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1785219977.107547:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219977.110562:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1871938465134080:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1785219977.110585:0:14242:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1785219977.110641:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1871938465134208:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1785219977.110699:0:14242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219977.110765:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a60c600 going to sleep for 11 seconds 00000100:00100000:2.0:1785219977.110874:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134208 00000100:00100000:2.0:1785219977.110882:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134208 00000100:00100000:2.0:1785219977.110943:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785219977.110953:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14242:x1871938465134208:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1785219977.111012:0:14853:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:1.0:1785219977.114720:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1785219977.129071:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14242:x1871938465134208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18111us (18363us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1785219977.129084:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785219977.131599:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14242:1871938465134208:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1785219977.131634:0:14242:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:01000004:2.0:1785219977.800611:0:15522:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1785219977.800615:0:15522:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1785219977.800767:0:15522:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9cf244b37800 00000020:01000004:2.0:1785219977.800784:0:15522:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1785219977.800797:0:15522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1785219977.800821:0:15522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cf2449d8000) 00000020:00000080:2.0:1785219977.800840:0:15522:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1785219977.834173:0:15522:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1785219977.834539:0:15522:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1785219977.835166:0:15522:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785219977.835459:0:15522:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1785219977.835659:0:15522:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1785219977.838611:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 429: rc = 0 00100000:10000000:3.0:1785219977.838753:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 429: rc = 0 00100000:10000000:3.0:1785219977.838851:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 429: rc = 0 00100000:10000000:3.0:1785219977.839739:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 775: rc = 0 00100000:10000000:3.0:1785219977.840114:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:3.0:1785219977.841558:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 775: rc = 0 00100000:10000000:3.0:1785219977.841855:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 775: rc = 0 00100000:10000000:3.0:1785219977.842111:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:3.0:1785219977.844628:0:15522:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 775: rc = 0 00000020:00000080:3.0:1785219977.846011:0:15522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1785219977.846026:0:15522:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785219977.846039:0:15522:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8b38d407a078d9d7 00000020:01000004:3.0:1785219977.846048:0:15522:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1785219977.846071:0:15522:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785219977.846075:0:15522:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785219977.846082:0:15522:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1785219977.846105:0:15522:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1785219977.846110:0:15522:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1785219977.860912:0:15522:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1785219977.860950:0:15522:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.131@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1785219977.860955:0:15522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1785219977.860956:0:15522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785219977.860958:0:15522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219977.860963:0:15522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219977.860965:0:15522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219977.860966:0:15522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219977.860968:0:15522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785219977.860969:0:15522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219977.860971:0:15522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219977.860976:0:15522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1785219977.860978:0:15522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785219977.860979:0:15522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785219977.860980:0:15522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785219977.860981:0:15522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785219977.860982:0:15522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785219977.860983:0:15522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785219977.860984:0:15522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785219977.860985:0:15522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785219977.860986:0:15522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785219977.861013:0:15522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1785219977.861037:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1785219977.861108:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219977.861231:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351ece9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219977.861325:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134336 00000100:00100000:2.0:1785219977.861332:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134336 00000100:00100000:2.0:1785219977.861824:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785219977.861834:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:15522:x1871938465134336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785219977.861883:0:14213:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1785219977.861886:0:14213:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1785219977.861891:0:14213:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1785219977.872802:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:15522:x1871938465134336:12345-0@lo:253:mount.lustre.0 Request processed in 10960us (11683us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219977.872819:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785219977.873535:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1785219977.873552:0:15522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1785219977.873556:0:15522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785219977.873558:0:15522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785219977.873578:0:15522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219977.873580:0:15522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785219977.873581:0:15522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219977.873583:0:15522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219977.873585:0:15522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219977.873586:0:15522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219977.873588:0:15522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1785219977.873613:0:15522:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf244b37800 from lustre-OST0001 10000000:01000000:2.0:1785219977.873656:0:15522:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1785219977.873660:0:15522:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1785219977.873669:0:15522:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf34806b380 local copy 00010000:00010000:2.0:1785219977.873680:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219977.873921:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219977.873971:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.874011:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aee180 going to sleep for 11 seconds 00000100:00100000:0.0:1785219977.874260:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134464 00000100:00100000:0.0:1785219977.874266:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134464 00000100:00100000:0.0:1785219977.874317:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1785219977.874326:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:15522:x1871938465134464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785219977.875018:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+16:15522:x1871938465134464:12345-0@lo:501:mount.lustre.0 Request processed in 691us (1044us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785219977.875028:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1785219977.875161:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134464:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1785219977.875251:0:15522:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1785219977.875440:0:15522:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1785219977.875449:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.875459:0:15522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf348a28200/0x8b38d407a078d784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d78b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785219977.875485:0:15522:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf244b37800 10000000:01000000:2.0:1785219977.875490:0:15522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1785219977.875495:0:15522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1785219977.875498:0:15522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785219977.875503:0:15522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1785219977.875514:0:15522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1785219977.875783:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9400/0x8b38d407a078d9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.875794:0:15522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9400/0x8b38d407a078d9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.875805:0:15522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9400/0x8b38d407a078d9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219977.875825:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1785219977.875865:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.875901:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aee180 going to sleep for 11 seconds 00000100:00100000:3.0:1785219977.876255:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134592 00000100:00100000:3.0:1785219977.876263:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134592 00000100:00100000:3.0:1785219977.876313:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785219977.876322:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf34a9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+16:15522:x1871938465134592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219977.876336:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219977.876361:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f06200/0x8b38d407a078d9e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d9de expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.876424:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f06200/0x8b38d407a078d9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d9de expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.876449:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f06200/0x8b38d407a078d9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d9de expref: 17 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.876458:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06200, rc 0) 00000100:00100000:3.0:1785219977.876634:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf34a9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465134592:12345-0@lo:101:mount.lustre.0 Request processed in 313us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219977.876641:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1785219977.879553:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219977.879586:0:15522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9400/0x8b38d407a078d9de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d9e5 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.879600:0:15522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9400/0x8b38d407a078d9de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078d9e5 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785219977.880349:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1785219977.881243:0:15522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785219977.881558:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1785219977.881608:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1785219977.881639:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1785219977.881678:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1785219977.881707:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1785219977.881736:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1785219977.881797:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1785219977.881805:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1785219977.881891:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219977.881961:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.882007:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aeef00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219977.882270:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134720 00000100:00100000:1.0:1785219977.882279:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134720 00000100:00100000:1.0:1785219977.882331:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785219977.882576:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf34a9a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465134720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219977.882945:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf34a9a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465134720:12345-0@lo:501:mount.lustre.0 Request processed in 604us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219977.882953:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1785219977.886846:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219977.886924:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785219977.887015:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.887052:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aeef00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219977.890546:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134848 00000100:00100000:0.0:1785219977.890561:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134848 00000100:00100000:0.0:1785219977.890636:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1785219977.890656:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf34a9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465134848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785219977.891100:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf34a9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465134848:12345-0@lo:503:mount.lustre.0 Request processed in 455us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219977.891109:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1785219977.891330:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785219977.891968:0:15522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785219977.892045:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785219977.892106:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.892150:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aeef00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219977.892272:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465134976 00000100:00100000:3.0:1785219977.892279:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465134976 00000100:00100000:3.0:1785219977.892315:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785219977.892323:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465134976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785219977.893666:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465134976:12345-0@lo:502:mount.lustre.0 Request processed in 1338us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219977.893677:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1785219977.893844:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465134976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785219977.894135:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1785219977.894193:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1785219977.894240:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1785219977.894295:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1785219977.894334:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1785219977.895752:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1785219977.896569:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1785219977.896612:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1785219977.896663:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1785219977.896720:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785219977.896823:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.896862:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aeef00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219977.898600:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465135104 00000100:00100000:0.0:1785219977.898613:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465135104 00000100:00100000:0.0:1785219977.898684:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785219977.898694:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465135104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785219977.898972:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465135104:12345-0@lo:502:mount.lustre.0 Request processed in 278us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219977.898988:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785219977.899895:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785219977.900036:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1785219977.900051:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1785219977.902263:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1785219977.902275:0:15524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1785219977.902282:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785219977.902285:0:15524:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1785219977.902291:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785219977.902306:0:15524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cf2449dcd40) 00000020:00000080:2.0:1785219977.902331:0:15524:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1785219977.902337:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785219977.902464:0:15524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf244b37800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1785219977.902472:0:15524:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785219977.902479:0:15524:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8b38d407a078d9f3 00010000:00010000:3.0:1785219977.908005:0:15524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1785219977.908548:0:15524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1785219977.912546:0:15524:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1785219977.916151:0:15524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1785219977.916166:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219977.916174:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219977.916177:0:15524:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1785219977.916181:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219977.916186:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219977.916188:0:15524:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1785219977.916191:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1785219977.916193:0:15524:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1785219977.916196:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219977.916198:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219977.916199:0:15524:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1785219977.916201:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785219977.916210:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219977.916224:0:15524:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1785219977.916229:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1785219977.916293:0:15524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785219977.916296:0:15524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785219977.916298:0:15524:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1785219977.916301:0:15524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1785219977.916434:0:15522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1785219977.916466:0:15522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1785219977.916481:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9400/0x8b38d407a078d9de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d9e5 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.916494:0:15522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9400/0x8b38d407a078d9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078d9e5 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219977.916503:0:15522:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf244b37800 from 1 10000000:01000000:3.0:1785219977.916506:0:15522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785219977.916553:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.916562:0:15522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.916573:0:15522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219977.916599:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785219977.916742:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219977.916786:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35061d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785219977.918494:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465135232 00000100:00100000:1.0:1785219977.918507:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465135232 00000100:00100000:1.0:1785219977.918555:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785219977.918565:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+17:15522:x1871938465135232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785219977.918591:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219977.918610:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078d9fa expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.918641:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.918651:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219977.918659:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3413cd400, rc 0) 00000100:00100000:1.0:1785219977.918725:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135232:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219977.918731:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1785219977.919023:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785219977.919044:0:15522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219977.919053:0:15522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785219977.925041:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1785219977.926748:0:15522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785219977.927100:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1785219977.927147:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1785219977.928487:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1785219977.928509:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1785219977.928624:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219977.928697:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219977.928742:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a60cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785219977.929794:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465135360 00000100:00100000:0.0:1785219977.929804:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465135360 00000100:00100000:0.0:1785219977.929865:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1785219977.929875:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785219977.930235:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135360:12345-0@lo:501:mount.lustre.0 Request processed in 360us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219977.930243:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785219977.930425:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219977.930475:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219977.930536:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219977.930570:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a60cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219977.930744:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465135488 00000100:00100000:2.0:1785219977.930751:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465135488 00000100:00100000:2.0:1785219977.930784:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1785219977.930791:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785219977.930958:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135488:12345-0@lo:503:mount.lustre.0 Request processed in 166us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219977.930964:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785219977.931040:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785219977.932107:0:15522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785219977.932173:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219977.932240:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219977.932275:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a60cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785219977.932343:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465135616 00000100:00100000:2.0:1785219977.932349:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465135616 00000100:00100000:2.0:1785219977.932417:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785219977.932425:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3810b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785219977.932768:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3810b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135616:12345-0@lo:502:mount.lustre.0 Request processed in 343us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219977.932776:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785219977.932839:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785219977.933081:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1785219977.933126:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1785219977.933172:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1785219977.933209:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1785219977.933260:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1785219977.933325:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1785219977.933473:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1785219977.933579:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1785219977.933610:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219977.933656:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219977.933749:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a60cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785219977.933787:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465135744 00000100:00100000:0.0:1785219977.933793:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465135744 00000100:00100000:0.0:1785219977.933858:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785219977.933866:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785219977.934027:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135744:12345-0@lo:502:mount.lustre.0 Request processed in 162us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219977.934034:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785219977.934125:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1785219977.934230:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1785219977.934241:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1785219977.936190:0:15528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219977.936203:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219977.936205:0:15528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785219977.936224:0:15528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf244b37800 00000020:00000080:0.0:1785219977.936227:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785219977.936236:0:15528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219977.936238:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219977.936239:0:15528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1785219977.936242:0:15528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219977.936245:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219977.936246:0:15528:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1785219977.936249:0:15528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf244b37800 00000020:00000080:0.0:1785219977.936251:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785219977.936351:0:15528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219977.936355:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219977.936357:0:15528:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1785219977.936359:0:15528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785219977.936656:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219977.936659:0:15528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1785219977.936664:0:15528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf244b37800 00000020:00000080:0.0:1785219977.936666:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785219977.943828:0:15528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785219977.943841:0:15528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785219977.943843:0:15528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1785219977.943849:0:15528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1785219977.944036:0:15522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1785219977.944068:0:15522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219977.944094:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.944108:0:15522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219977.944164:0:15522:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785219977.944167:0:15522:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf244b37800 10000000:01000000:3.0:1785219977.944170:0:15522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf244b37800 10000000:01000000:3.0:1785219977.944174:0:15522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785219977.944180:0:15522:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9cf244b37800 from 1 10000000:01000000:3.0:1785219977.944183:0:15522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785219977.944235:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06800/0x8b38d407a078da08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.944254:0:15522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f06800/0x8b38d407a078da08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.944265:0:15522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f06800/0x8b38d407a078da08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219977.944292:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785219977.944752:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219977.944807:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465135872 00000100:00100000:3.0:1785219977.944816:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465135872 00000100:00100000:3.0:1785219977.944859:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785219977.944869:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465135872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219977.944882:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219977.944896:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07800/0x8b38d407a078da0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078da08 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.944919:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07800/0x8b38d407a078da0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078da08 expref: 19 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.944928:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07800/0x8b38d407a078da0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078da08 expref: 19 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.944936:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07800, rc 0) 00000100:00100000:3.0:1785219977.944973:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465135872:12345-0@lo:101:mount.lustre.0 Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219977.944979:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785219977.945023:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35061de40 going to sleep for 11 seconds 00000100:00100000:3.0:1785219977.945054:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465135872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785219977.945071:0:15522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f06800/0x8b38d407a078da08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da0f expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219977.945080:0:15522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06800/0x8b38d407a078da08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078da0f expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785219977.947009:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1785219977.951028:0:15522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785219977.954880:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1785219977.954989:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1785219977.955027:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1785219977.955095:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1785219977.955133:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1785219977.955207:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1785219977.955260:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1785219977.955291:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1785219977.955342:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1785219977.956914:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1785219977.956973:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1785219977.957047:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1785219977.957085:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1785219977.957121:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1785219977.957171:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1785219977.957207:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1785219977.957256:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1785219977.957301:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1785219977.957335:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1785219977.958550:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1785219977.958653:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1785219977.958712:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1785219977.958750:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1785219977.958826:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1785219977.958866:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1785219977.958899:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1785219977.958946:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1785219977.958983:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1785219977.959016:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1785219977.959062:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1785219977.959097:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1785219977.959128:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1785219977.959175:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1785219977.959236:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1785219977.959273:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1785219977.959318:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1785219977.959353:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1785219977.963912:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1785219977.963931:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1785219977.964045:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785219977.964110:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219977.964150:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf35061de40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219977.965939:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136000 00000100:00100000:1.0:1785219977.965951:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136000 00000100:00100000:1.0:1785219977.966166:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785219977.966178:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785219977.968954:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136000:12345-0@lo:501:mount.lustre.0 Request processed in 2771us (4835us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219977.968970:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785219977.969259:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785219977.969313:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785219977.969385:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.969421:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342f7cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219977.969518:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136128 00000100:00100000:1.0:1785219977.969525:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136128 00000100:00100000:1.0:1785219977.970344:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1785219977.970356:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785219977.970760:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136128:12345-0@lo:503:mount.lustre.0 Request processed in 406us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219977.970768:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785219977.970843:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785219977.972878:0:15522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785219977.972967:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785219977.973041:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219977.973114:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf342f7cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785219977.978508:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136256 00000100:00100000:1.0:1785219977.978522:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136256 00000100:00100000:1.0:1785219977.978680:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785219977.978693:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219977.979045:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136256:12345-0@lo:502:mount.lustre.0 Request processed in 355us (6003us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219977.979053:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1785219977.979899:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1785219977.980132:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1785219977.980170:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1785219977.980187:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1785219977.980210:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1785219977.980261:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1785219977.980309:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1785219977.980499:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1785219977.980609:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1785219977.980670:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1785219977.980705:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1785219977.980920:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1785219977.980977:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1785219977.981015:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1785219977.981049:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1785219977.981094:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1785219977.981128:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1785219977.981162:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1785219977.981208:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1785219977.981456:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1785219977.981523:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1785219977.981597:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1785219977.981635:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1785219977.981672:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1785219977.981723:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1785219977.981803:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1785219977.981852:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1785219977.981905:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1785219977.981944:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1785219977.981980:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1785219977.982044:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1785219977.982070:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1785219977.982086:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1785219977.982102:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1785219977.982127:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1785219977.982145:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1785219977.982169:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1785219977.982187:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1785219977.982220:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1785219977.982272:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1785219977.982302:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1785219977.982344:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785219977.982449:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219977.982490:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136384 00000100:00100000:0.0:1785219977.982492:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf345f54480 going to sleep for 11 seconds 00000100:00100000:1.0:1785219977.982497:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136384 00000100:00100000:1.0:1785219977.982548:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785219977.982557:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785219977.982971:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136384:12345-0@lo:502:mount.lustre.0 Request processed in 414us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219977.982980:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785219977.983097:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785219977.983180:0:15522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1785219977.983194:0:15522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1785219977.988116:0:15533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1785219977.988129:0:15533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cf2449d99c0) 00000020:00000080:2.0:1785219977.988147:0:15533:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1785219977.988327:0:15533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf244b37800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1785219977.988333:0:15533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf244b37800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1785219977.988335:0:15533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf244b37800 3 00010000:00080000:2.0:1785219977.988520:0:15533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf34302d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.131@tcp at head 00010000:00010000:2.0:1785219977.991965:0:15533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1785219977.992098:0:15533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1785219977.992143:0:15533:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1785219977.992159:0:15533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8b38d407a078da1d 00000100:00080000:2.0:1785219977.992170:0:15533:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785219977.992177:0:15533:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cf34302d800 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:2.0:1785219977.992222:0:15533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf38114d880 x1871938465136512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785219977.992252:0:15533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1785219977.992314:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465136512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785219977.992425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219977.992487:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136512 00000100:00100000:0.0:1785219977.992494:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136512 00000100:00100000:0.0:1785219977.992523:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785219977.992530:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1871938465136512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1785219977.992566:0:14219:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1785219977.992602:0:14219:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8b38d407a078da24 00000004:00100000:0.0:1785219977.992618:0:14219:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785219977.992646:0:14219:0:(import.c:65:import_set_state_nolock()) ffff9cf37e4b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219977.992694:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871938465136512:12345-0@lo:38:llog_process_th.0 Request processed in 163us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219977.992702:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1785219977.992754:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf38114d880 x1871938465136512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785219987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219977.992772:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785219977.992780:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1785219977.992787:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1785219977.992791:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1785219977.992793:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf34302d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1785219977.992798:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1871938465136512:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1785219977.994771:0:15533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1785219977.994929:0:15522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1785219977.994957:0:15522:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785219977.994984:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06800/0x8b38d407a078da08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da0f expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219977.994997:0:15522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f06800/0x8b38d407a078da08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da0f expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1785219977.995047:0:15522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1785219977.995049:0:15522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1785219977.995051:0:15522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785219977.995052:0:15522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785219977.995053:0:15522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785219977.995054:0:15522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785219977.995060:0:15522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785219977.995062:0:15522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785219977.995063:0:15522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1785219977.995067:0:15522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1785219977.995069:0:15522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1785219977.995070:0:15522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1785219977.995071:0:15522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785219977.995072:0:15522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785219977.995072:0:15522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785219977.995073:0:15522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785219977.995074:0:15522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785219977.995075:0:15522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785219977.995076:0:15522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1785219977.995101:0:15522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1785219977.995118:0:15522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1785219977.995190:0:15522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219977.995237:0:15522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3487c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785219977.995258:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136640 00000100:00100000:0.0:1785219977.995264:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136640 00000100:00100000:0.0:1785219977.995300:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1785219977.995307:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+19:15522:x1871938465136640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1785219977.995329:0:14211:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1785219977.995342:0:14211:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1785219977.998761:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785219977.998768:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1785219977.998772:0:475:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785219977.998780:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1785219977.998785:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1785219977.998792:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf342ddf000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:3.0:1785219977.998815:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf381a2bb80 x1871938465136896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785219977.998885:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465136768:0@lo:400:kworker.0 00000100:00100000:3.0:1785219977.998949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219977.999015:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785219977.999022:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465137024:0@lo:400:kworker.0 00000100:00100000:3.0:1785219977.999046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219977.999197:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465137152:0@lo:400:kworker.0 00000100:00100000:3.0:1785219977.999232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219977.999265:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137024 00000100:00100000:3.0:1785219977.999271:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137024 00000100:00100000:3.0:1785219977.999305:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137152 00000100:00100000:3.0:1785219977.999307:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137152 00000100:00100000:3.0:1785219977.999329:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785219977.999337:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465137024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219977.999422:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465137024:12345-0@lo:400:kworker.0 Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219977.999430:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785219977.999446:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785219977.999452:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465137152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785219977.999484:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465137152:12345-0@lo:400:kworker.0 Request processed in 32us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219977.999489:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1785219977.999503:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785219977.999546:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf381a2b800 x1871938465137152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219977.999557:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465137152:0@lo:400:kworker.0 00000100:00100000:2.0:1785219977.999949:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136768 00000100:00100000:2.0:1785219977.999955:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136768 00000100:00100000:2.0:1785219977.999990:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785219977.999997:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465136768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219978.000036:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465136768:12345-0@lo:400:kworker.0 Request processed in 40us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219978.000042:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785219978.000698:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465136896:0@lo:8:kworker.0 00000100:00100000:0.0:1785219978.000759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1785219978.001160:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf381a28a80 x1871938465137024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785219978.001174:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465137024:0@lo:400:kworker.0 00000100:00100000:3.0:1785219978.001207:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465136768:0@lo:400:kworker.0 00000100:00100000:3.0:1785219978.001246:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465136896 00000100:00100000:3.0:1785219978.001252:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465136896 00000100:00100000:3.0:1785219978.001285:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785219978.001291:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1871938465136896:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1785219978.001346:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1871938465136896:12345-0@lo:8:kworker.0 Request processed in 54us (587us total) trans 0 rc -11/-11 00000100:00100000:3.0:1785219978.001726:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785219978.001903:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785219978.001911:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785219978.001915:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1785219978.001918:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465136896:0@lo:8:kworker.0 20000000:01000000:1.0:1785219978.047462:0:14211:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1785219978.047484:0:14211:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1785219978.047667:0:14235:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785219978.047674:0:14235:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785219978.047698:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219978.047716:0:14235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219978.047745:0:14235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219978.047798:0:14235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219978.048029:0:14235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 19 pid: 14213 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219978.048046:0:14235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1871938465137280:0@lo:104: 00000100:00100000:0.0:1785219978.048183:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219978.048235:0:14235:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3506ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1785219978.048248:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137280 00000100:00100000:1.0:1785219978.048255:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137280 00000100:00100000:1.0:1785219978.048302:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785219978.048311:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19240113-729d-48ac-b4dd-0e1109961383+3:14235:x1871938465137280:12345-0@lo:104: 00010000:00010000:1.0:1785219978.048323:0:14202:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219978.048787:0:14202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785219978.048795:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19240113-729d-48ac-b4dd-0e1109961383+3:14235:x1871938465137280:12345-0@lo:104: Request processed in 486us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219978.048803:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785219978.048973:0:14235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14235:1871938465137280:0@lo:104: 00010000:00010000:0.0:1785219978.048995:0:14235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049049:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219978.049056:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049064:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07000 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:3.0:1785219978.049069:0:14207:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049077:0:14207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785219978.049084:0:14207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219978.049090:0:14207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785219978.049233:0:14207:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049254:0:14207:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785219978.049282:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049289:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078d8fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d905 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219978.049292:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219978.049305:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465137408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785219978.049306:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219978.049308:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219978.049310:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219978.049339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219978.049410:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137408 00000100:00100000:3.0:1785219978.049415:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137408 00010000:00010000:3.0:1785219978.049438:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 20 pid: 14213 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219978.049460:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785219978.049468:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19240113-729d-48ac-b4dd-0e1109961383+20:3306:x1871938465137408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785219978.049480:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785219978.049486:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 20 pid: 14213 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049496:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 20 pid: 14213 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049510:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078d905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078d8fe expref: 20 pid: 14213 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049524:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049545:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785219978.049558:0:14206:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001886094s 00010000:00010000:3.0:1785219978.049563:0:14206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049569:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049575:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049582:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049587:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219978.049591:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049598:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049618:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219978.049628:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785219978.049678:0:14235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219978.049686:0:14235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219978.049692:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3489b0600/0x8b38d407a078da2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219978.049896:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19240113-729d-48ac-b4dd-0e1109961383+19:3306:x1871938465137408:12345-0@lo:103:ldlm_bl.0 Request processed in 428us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219978.049903:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785219978.050104:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465137408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785219978.058907:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+18:15522:x1871938465136640:12345-0@lo:253:mount.lustre.0 Request processed in 63590us (63707us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219978.058943:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785219978.059046:0:15522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19240113-729d-48ac-b4dd-0e1109961383:15522:1871938465136640:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1785219978.059062:0:15522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1785219978.059065:0:15522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785219978.059067:0:15522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785219978.059068:0:15522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785219978.059070:0:15522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785219978.059071:0:15522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785219978.059072:0:15522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785219978.059074:0:15522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785219978.059076:0:15522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785219978.059077:0:15522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1785219978.059092:0:15522:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785219978.065561:0:15522:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1785219978.065752:0:15522:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785219978.065921:0:15522:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1785219978.066096:0:15522:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785219978.066265:0:15522:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1785219978.066610:0:15522:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1785219978.067939:0:15522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1785219978.101418:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1785219978.136925:0:15522:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1785219978.136938:0:15522:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1785219978.136980:0:15522:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1785219978.137054:0:15522:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1785219978.137069:0:15522:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1785219978.137100:0:15522:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1785219979.116546:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1785219979.627993:0:14216:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785219979.628003:0:14216:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9cf356ac9800 from 8 10000000:01000000:0.0:1785219979.628009:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785219979.628249:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078da32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219979.628261:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078da32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219979.628272:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078da32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219979.628310:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465137536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785219979.628411:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219979.628458:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3411ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785219979.628757:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137536 00000100:00100000:2.0:1785219979.628765:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137536 00000100:00100000:2.0:1785219979.628884:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785219979.628895:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:14216:x1871938465137536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219979.628910:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219979.628926:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf37edc9800/0x8b38d407a078da39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078da32 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219979.628949:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf37edc9800/0x8b38d407a078da39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078da32 expref: 19 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219979.628961:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf37edc9800/0x8b38d407a078da39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078da32 expref: 19 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219979.628970:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9800, rc 0) 00000100:00100000:2.0:1785219979.629027:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:14216:x1871938465137536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219979.629034:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1785219979.629105:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465137536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219979.629122:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078da32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da39 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219979.629131:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078da32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078da39 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219979.629196:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465137664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1785219979.629248:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219979.629278:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf2453506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785219979.629290:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137664 00000100:00100000:0.0:1785219979.629294:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137664 00000100:00100000:0.0:1785219979.629324:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785219979.629331:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+19:14216:x1871938465137664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1785219979.629345:0:14211:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1785219979.629385:0:14211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1785219979.629389:0:14211:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1785219979.629483:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+19:14216:x1871938465137664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219979.629491:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785219979.629511:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465137664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1785219979.629567:0:14216:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1785219979.629575:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078da32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da39 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219979.629583:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf3489b0c00/0x8b38d407a078da32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078da39 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219980.145265:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785219980.267438:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1785219980.267713:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1785219981.166165:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219982.191785:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219982.255443:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785219982.255476:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465137792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785219982.255608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219982.255746:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137792 00000100:00100000:0.0:1785219982.255756:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137792 00000100:00100000:0.0:1785219982.255862:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785219982.255880:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465137792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785219982.255933:0:14857:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219982.256012:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465137792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219982.256033:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1785219982.256064:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219982.256117:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1785219982.256157:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465137792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785219983.211934:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785219983.281581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785219983.281588:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1785219983.281591:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785219983.281604:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf342ddf000 using connection 192.168.203.131@tcp/0@lo 00000100:00100000:0.0:1785219983.281628:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf349c62d80 x1871938465138176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785219983.281717:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465137920:0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.281717:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465138432:0@lo:400:kworker.0 00000100:00100000:2.0:1785219983.281795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219983.281797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219983.281850:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465138560:0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.281869:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465138048:0@lo:400:kworker.0 00000100:00100000:2.0:1785219983.281894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219983.281906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219983.281935:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785219983.281945:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465138304:0@lo:400:kworker.0 00000100:00100000:2.0:1785219983.281957:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138432 00000100:00100000:2.0:1785219983.281965:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138432 00000100:00100000:0.0:1785219983.281981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219983.282020:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138560 00000100:00100000:2.0:1785219983.282025:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138560 00000100:00100000:0.0:1785219983.282025:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465138176:0@lo:8:kworker.0 00000100:00100000:2.0:1785219983.282047:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138304 00000100:00100000:2.0:1785219983.282051:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138304 00000100:00100000:0.0:1785219983.282061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219983.282071:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785219983.282080:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.282100:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465137920 00000100:00100000:0.0:1785219983.282105:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465137920 00000100:00100000:2.0:1785219983.282142:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465138432:12345-0@lo:400:kworker.0 Request processed in 61us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219983.282146:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785219983.282156:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785219983.282160:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:3309:x1871938465137920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219983.282188:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219983.282196:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465138560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.282217:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:3309:x1871938465137920:12345-0@lo:400:kworker.0 Request processed in 60us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219983.282226:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785219983.282234:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465138560:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219983.282242:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785219983.282256:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785219983.282264:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465138304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.282280:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138048 00000100:00100000:0.0:1785219983.282285:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138048 00000100:00100000:2.0:1785219983.282299:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871938465138304:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219983.282307:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785219983.282316:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138176 00000100:00100000:0.0:1785219983.282321:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138176 00000100:00100000:0.0:1785219983.282335:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785219983.282341:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465138048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.282398:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465138048:12345-0@lo:400:kworker.0 Request processed in 57us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219983.282404:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785219983.282415:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785219983.282419:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1871938465138176:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1785219983.282441:0:14853:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1785219983.282468:0:14853:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8b38d407a078da40 00002000:00100000:0.0:1785219983.282481:0:14853:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cf37e4b7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cc ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1785219983.282486:0:14853:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1785219983.282489:0:14853:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1785219983.282870:0:14853:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785219983.282897:0:14853:0:(import.c:65:import_set_state_nolock()) ffff9cf37e4b1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219983.282939:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1871938465138176:12345-0@lo:8:kworker.0 Request processed in 517us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219983.282947:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1785219983.282965:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785219983.283257:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf349c62d80 x1871938465138176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785220008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1785219983.283273:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1785219983.283283:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1785219983.283289:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1785219983.283292:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9cf342ddf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1785219983.283316:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1785219983.283323:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1871938465138176:0@lo:8:kworker.0 00000004:00080000:2.0:1785219983.283337:0:14243:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1785219983.283393:0:14244:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1785219983.283414:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247278000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1871938465138816:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1785219983.283443:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219983.283459:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf371aeed80 going to sleep for 11 seconds 00000100:00100000:0.0:1785219983.283470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219983.283480:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf247279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465138688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219983.283508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219983.283536:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138688 00000100:00100000:0.0:1785219983.283541:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138688 00000100:00100000:0.0:1785219983.283583:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785219983.283594:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465138688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785219983.283616:0:14857:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219983.283653:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871938465138688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219983.283668:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1785219983.283689:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1785219983.283712:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf247279880 x1871938465138688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785219999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219983.283728:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465138688:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1785219983.283762:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf349c60e00 x1871938465138304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1785219983.283769:0:14243:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476136404034ns, next at 0ns, rc = 0 00000100:00100000:0.0:1785219983.283773:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871938465138304:0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.283790:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465138048:0@lo:400:kworker.0 00010000:00080000:0.0:1785219983.283830:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf349c61c00 x1871938465138432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219983.283840:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465138432:0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.283880:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465137920:0@lo:400:kworker.0 00010000:00080000:0.0:1785219983.283892:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf247279f80 x1871938465138560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785219999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785219983.283902:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465138560:0@lo:400:kworker.0 00000100:00100000:0.0:1785219983.283929:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138816 00000100:00100000:0.0:1785219983.283933:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138816 00000100:00100000:0.0:1785219983.283962:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785219983.283971:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14244:x1871938465138816:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1785219983.294608:0:14853:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1785219983.294619:0:14853:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1785219983.294633:0:14853:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1785219983.313082:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.313098:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.313116:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.313121:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.313128:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.313149:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.313174:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.313193:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.313214:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219983.313801:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219983.313810:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.313819:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cc800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219983.313823:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.313832:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.313851:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.313860:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebea680a/0x8b38d407a078da47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.313880:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.313882:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.313883:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.316168:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.316191:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.316207:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.316212:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.316218:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.316233:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.316832:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.316844:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.316883:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219983.318162:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219983.318172:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.318193:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cd600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219983.318198:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.318217:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.318239:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.318262:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019d0f9ff/0x8b38d407a078da4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.318288:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.318290:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.318292:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.320516:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.320532:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.320629:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.320635:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.320643:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.320771:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.320784:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.320792:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.320816:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785219983.321221:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219983.321228:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.321254:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cca00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.321259:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.321269:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.321290:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.321298:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075934b00/0x8b38d407a078da55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.321319:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.321321:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.321323:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.324354:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.324390:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324409:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.324422:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.324428:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324442:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324453:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324460:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324480:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219983.324494:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219983.324499:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324507:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cce00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219983.324512:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324521:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324536:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324568:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e000d2/0x8b38d407a078da5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.324591:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.324594:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.324595:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.325189:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.325196:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325205:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.325209:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.325214:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325224:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325233:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325240:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325258:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219983.325270:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219983.325279:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325286:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cc600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219983.325290:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325298:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325310:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325317:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1e44746/0x8b38d407a078da63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.325331:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.325333:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.325335:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.327069:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.327081:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327099:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.327103:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.327109:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327135:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327144:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327151:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327184:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785219983.327202:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219983.327208:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327215:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3413cc000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219983.327219:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327227:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.327241:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.328236:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ab2b7fd/0x8b38d407a078da6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.328288:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.328290:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.328292:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.332928:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.332950:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.332968:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.332974:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.332980:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.333000:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.333012:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.333020:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.333043:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785219983.334956:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.334972:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.335001:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.335006:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.335012:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.335025:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.335035:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.335043:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.335074:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785219983.335321:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785219983.335330:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335341:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675200 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219983.335353:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335386:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335409:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335418:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c14f3d6f/0x8b38d407a078da71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335446:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219983.335451:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335459:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674200 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219983.335462:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.335688:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.335964:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335977:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.335985:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052741742/0x8b38d407a078da78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.336007:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.336009:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.336011:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.340923:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.340938:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.340956:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.340961:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.340968:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.340984:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.341006:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.341015:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.341041:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785219983.342035:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.342044:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.342056:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.342060:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.342065:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.342077:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.342086:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.342094:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.342130:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1785219983.342779:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785219983.342788:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342799:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.342804:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342828:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342846:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342854:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1bb92b7/0x8b38d407a078da7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342874:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219983.342877:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342883:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.342885:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342892:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342900:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342907:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e24fc22/0x8b38d407a078da86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.342931:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.342933:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.342934:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.342987:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.343151:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.343159:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.343170:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.343184:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.343191:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.343203:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.343211:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.343218:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.343232:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785219983.343480:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219983.343485:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.343494:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.343498:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.343517:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.343531:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.343539:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053b4e33f/0x8b38d407a078da8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.343562:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.343564:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.343566:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.344848:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.344858:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.344872:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.344882:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.344888:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.344901:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.344909:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.344916:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.344930:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785219983.346314:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.346325:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.346340:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.346343:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.346348:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.346360:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.346397:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.346411:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.346431:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785219983.346870:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785219983.346879:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346890:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219983.346895:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346907:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346926:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346935:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efe53472/0x8b38d407a078da94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346958:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219983.346962:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346969:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219983.346979:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346986:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.346996:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.347003:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a87e9d79/0x8b38d407a078da9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.347015:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.347016:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.347018:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.347096:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1785219983.347641:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1785219983.348158:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.348168:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.348193:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.348197:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.348204:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.348216:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.348225:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.348233:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.348893:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785219983.349247:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785219983.349256:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.349267:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219983.349271:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.349282:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.349303:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.349319:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c3de515/0x8b38d407a078daa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.349344:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.349346:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785219983.349349:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.350066:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.350074:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.350093:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.350097:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.350104:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.350117:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.350126:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.350134:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.352800:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219983.352998:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219983.353007:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.353021:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219983.353026:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.353038:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.353061:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.353082:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000365048dc/0x8b38d407a078daa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.353109:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.353112:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.353115:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.353919:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.353928:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.353942:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.353947:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.353953:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.353966:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.353987:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.353995:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.354024:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219983.354211:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219983.354218:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.354227:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219983.354231:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.354239:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.354254:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.354261:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4611392/0x8b38d407a078dab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.354278:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.354280:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.354282:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.357818:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.357833:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.357852:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.357856:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.357863:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.357877:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.357888:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.357896:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.357936:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785219983.359044:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219983.359062:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.359074:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.359078:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.359088:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.359108:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.359117:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc29655/0x8b38d407a078dab7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.359141:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.359143:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.359144:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.360142:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.360153:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.360168:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.360173:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.360742:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.360760:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.360772:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.360781:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.360811:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219983.360977:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219983.360986:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.360998:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219983.361005:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361016:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361037:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361044:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3ba5137/0x8b38d407a078dabe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361073:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.361076:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.361078:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.361446:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.361453:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.361464:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.361474:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.361479:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.361489:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.361497:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.361504:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.361530:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785219983.361637:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785219983.361642:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361650:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785219983.361654:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361674:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361687:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361694:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a47b0fa/0x8b38d407a078dac5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219983.361711:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.361712:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.361714:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785219983.363185:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.363196:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.363212:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.363217:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.363224:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.363238:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.365268:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.365293:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.365317:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785219983.366172:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785219983.366193:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366207:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1785219983.366212:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785219983.366220:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366236:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366464:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366473:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366602:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1785219983.366621:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785219983.366627:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366643:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219983.366649:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366658:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366678:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366685:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c776817/0x8b38d407a078dacc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366705:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219983.366708:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366715:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219983.366719:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366726:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366736:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366749:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc5b3ce8/0x8b38d407a078dad3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.366766:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.366768:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.366770:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785219983.368204:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785219983.374811:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785219983.374826:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.374843:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1785219983.374848:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219983.374854:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.374869:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.374880:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.374888:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.374912:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785219983.375478:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785219983.375491:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.375501:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1785219983.375504:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219983.375508:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.375517:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.375526:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.375533:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.375553:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1785219983.375960:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785219983.375967:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.375977:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1785219983.375980:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219983.375985:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.375995:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376010:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376019:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376029:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1785219983.376543:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785219983.376551:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376561:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1785219983.376564:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219983.376569:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376580:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376589:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376597:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.376621:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1785219983.377086:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785219983.377093:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377103:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1785219983.377106:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219983.377110:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377120:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377129:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377137:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377146:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1785219983.377676:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785219983.377683:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377694:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1785219983.377703:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219983.377708:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377718:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377727:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377733:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.377743:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1785219983.378418:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1785219983.378428:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.378438:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.378443:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.378465:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.378485:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.378495:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a78e5d/0x8b38d407a078dada lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.378513:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1785219983.378517:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.378525:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.378529:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.378664:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785219983.382710:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382749:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382758:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b390f75/0x8b38d407a078dae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382815:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785219983.382820:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382828:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.382833:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382844:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382855:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382862:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d21b463/0x8b38d407a078daef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382875:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785219983.382878:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382885:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.382888:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382909:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382920:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382928:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000106d1128/0x8b38d407a078daf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382943:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219983.382946:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382952:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9200 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.382956:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382963:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382973:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.382980:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008312ec61/0x8b38d407a078dafd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.383005:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.383007:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.383009:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785219983.387703:0:14853:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785219983.387723:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.387742:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1785219983.387747:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785219983.387754:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.387771:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.387783:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.387800:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219983.387851:0:14853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785219983.391130:0:14207:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785219983.391147:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.391161:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:3.0:1785219983.391166:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.391188:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.391212:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.391222:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c865040c/0x8b38d407a078db04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219983.391249:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.391251:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.391254:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1785219983.391681:0:14853:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1785219983.391786:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14244:x1871938465138816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 107813us (108337us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219983.391796:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785219983.391854:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf247278000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1871938465138816:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1785219983.391869:0:14244:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1785219983.391914:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1871938465138944:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1785219983.391956:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219983.391958:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785219983.391960:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785219983.391963:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219983.392015:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf381b78180 going to sleep for 11 seconds 00000100:00100000:2.0:1785219983.392055:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465138944 00000100:00100000:2.0:1785219983.392064:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465138944 00000100:00100000:2.0:1785219983.392123:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785219983.392133:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14244:x1871938465138944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1785219983.392195:0:14855:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1785219983.398709:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.398729:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8200 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785219983.398734:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.398746:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.398770:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.398778:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001908e3eb/0x8b38d407a078dae8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219983.398805:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.398808:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219983.398810:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219983.406932:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14244:x1871938465138944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14790us (14965us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1785219983.406951:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785219983.407146:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14244:1871938465138944:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1785219983.407321:0:14244:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1785219984.235697:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785219984.365557:0:15879:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg331-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1785219984.748882:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785219985.267479:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219986.283526:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219986.607746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.607830:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444172544 00000100:00100000:0.0:1785219986.607842:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444172544 00000100:00100000:0.0:1785219986.607893:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1785219986.607902:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1871938444172544:12345-192.168.203.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1785219986.607936:0:14214:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f3b54294-9d7e-4b42-96a3-9a0e0422cfbc@192.168.203.31@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1785219986.607968:0:14214:0:(genops.c:1406:class_connect()) connect: client f3b54294-9d7e-4b42-96a3-9a0e0422cfbc, cookie 0x8b38d407a078db0b 00000100:00080000:0.0:1785219986.608116:0:14214:0:(import.c:65:import_set_state_nolock()) ffff9cf37e4b0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219986.608205:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+5:2358:x1871938444172544:12345-192.168.203.31@tcp:250:mount.lustre.0 Request processed in 302us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.608212:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 75 00000100:00100000:0.0:1785219986.623509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219986.626445:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444172672 00000100:00100000:2.0:1785219986.626460:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444172672 00000100:00100000:2.0:1785219986.626515:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:2.0:1785219986.626525:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+5:13731:x1871938444172672:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785219986.626565:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219986.626592:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078db12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f6d4 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219986.626622:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078db12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6d4 expref: 6 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219986.626634:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf37edc8600/0x8b38d407a078db12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6d4 expref: 6 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219986.626644:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8600, rc 0) 00000100:00100000:2.0:1785219986.626716:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+6:13731:x1871938444172672:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 192us (3217us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219986.626728:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 76 00000100:00100000:3.0:1785219986.634401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.634603:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444172800 00000100:00100000:1.0:1785219986.634613:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444172800 00000100:00100000:1.0:1785219986.634671:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1785219986.634681:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+6:13731:x1871938444172800:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1785219986.635431:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+6:13731:x1871938444172800:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 747us (1073us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785219986.635441:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 77 00000100:00100000:1.0:1785219986.640124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.640233:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444172928 00000100:00100000:0.0:1785219986.640244:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444172928 00000100:00100000:0.0:1785219986.640302:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1785219986.640312:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36dc18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+6:13731:x1871938444172928:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785219986.640330:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219986.640346:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b1400/0x8b38d407a078db19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f6db expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.642017:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b1400/0x8b38d407a078db19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6db expref: 7 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.642035:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b1400/0x8b38d407a078db19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f6db expref: 7 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.642047:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1400, rc 0) 00000100:00100000:1.0:1785219986.642201:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36dc18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+7:13731:x1871938444172928:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 1889us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.642209:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 78 00000100:00100000:0.0:1785219986.649445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.649518:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173056 00000100:00100000:1.0:1785219986.649527:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173056 00000100:00100000:1.0:1785219986.649574:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:1.0:1785219986.649583:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36f4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+7:13731:x1871938444173056:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1785219986.649863:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36f4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13731:x1871938444173056:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 279us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.649878:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 79 00000100:00100000:3.0:1785219986.654557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.654657:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173184 00000100:00100000:1.0:1785219986.654667:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173184 00000100:00100000:1.0:1785219986.654724:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:1.0:1785219986.654734:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36f4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13731:x1871938444173184:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1785219986.655118:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36f4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13731:x1871938444173184:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 385us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.655127:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 80 00000100:00100000:3.0:1785219986.664514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219986.664614:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173312 00000100:00100000:2.0:1785219986.664625:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173312 00000100:00100000:2.0:1785219986.664685:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:2.0:1785219986.664695:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36f4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13750:x1871938444173312:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785219986.665049:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36f4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13750:x1871938444173312:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 354us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219986.665057:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 81 00000100:00100000:3.0:1785219986.690113:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.690225:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173440 00000100:00100000:0.0:1785219986.690234:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173440 00000100:00100000:0.0:1785219986.690289:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:0.0:1785219986.690298:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13750:x1871938444173440:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785219986.690623:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13750:x1871938444173440:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 324us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.690631:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 82 00000100:00100000:3.0:1785219986.699783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.702508:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173568 00000100:00100000:1.0:1785219986.702522:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173568 00000100:00100000:1.0:1785219986.702741:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:1.0:1785219986.702754:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+8:13731:x1871938444173568:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785219986.702855:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219986.702875:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf247674a00/0x8b38d407a078db20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f705 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.702905:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf247674a00/0x8b38d407a078db20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f705 expref: 9 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.702916:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf247674a00/0x8b38d407a078db20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f705 expref: 9 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.702924:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf247674a00, rc 0) 00000100:00100000:1.0:1785219986.702998:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+9:13731:x1871938444173568:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 245us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.703005:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 83 00000100:00100000:3.0:1785219986.714186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219986.715727:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173696 00000100:00100000:2.0:1785219986.715742:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173696 00000100:00100000:2.0:1785219986.716645:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:2.0:1785219986.716658:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+9:13731:x1871938444173696:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1785219986.716685:0:14211:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1785219986.716714:0:14211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1785219986.716718:0:14211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1785219986.716721:0:14211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1785219986.716723:0:14211:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1785219986.718775:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+9:13731:x1871938444173696:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 2109us (4587us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219986.718800:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 84 00000100:00100000:3.0:1785219986.722759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.723000:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173824 00000100:00100000:1.0:1785219986.723011:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173824 00000100:00100000:1.0:1785219986.723126:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:1.0:1785219986.723136:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+9:13731:x1871938444173824:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785219986.723163:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219986.723183:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f70c expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.723212:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 10 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.723225:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 10 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219986.723235:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf247674600, rc 0) 00000100:00100000:1.0:1785219986.723297:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13731:x1871938444173824:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 162us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.723304:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 85 00000100:00100000:2.0:1785219986.725766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.725922:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444173952 00000100:00100000:0.0:1785219986.725932:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444173952 00000100:00100000:0.0:1785219986.725992:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:0.0:1785219986.726002:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13731:x1871938444173952:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785219986.726335:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13731:x1871938444173952:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 333us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.726344:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 86 00000100:00100000:2.0:1785219986.728960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.729017:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174080 00000100:00100000:1.0:1785219986.729024:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174080 00000100:00100000:1.0:1785219986.729114:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:1.0:1785219986.729123:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13731:x1871938444174080:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1785219986.729638:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13731:x1871938444174080:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 514us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.729647:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 87 00000100:00100000:2.0:1785219986.732071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.732189:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174208 00000100:00100000:1.0:1785219986.732199:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174208 00000100:00100000:1.0:1785219986.732299:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:1.0:1785219986.732321:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13756:x1871938444174208:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785219986.732638:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13756:x1871938444174208:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 317us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.732646:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 88 00000100:00100000:2.0:1785219986.736227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.736487:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174336 00000100:00100000:1.0:1785219986.736498:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174336 00000100:00100000:1.0:1785219986.736596:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:1.0:1785219986.736607:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13756:x1871938444174336:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785219986.736859:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13756:x1871938444174336:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 253us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219986.736867:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 89 00000100:00100000:2.0:1785219986.744922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.750118:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174464 00000100:00100000:0.0:1785219986.750134:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174464 00000100:00100000:0.0:1785219986.750210:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1785219986.750219:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1871938444174464:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1785219986.750267:0:14221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 22b52ba8-0ef2-43ea-b50a-dd369f8218e8@192.168.203.31@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1785219986.750314:0:14221:0:(genops.c:1406:class_connect()) connect: client 22b52ba8-0ef2-43ea-b50a-dd369f8218e8, cookie 0x8b38d407a078db2e 00000004:00100000:0.0:1785219986.750343:0:14221:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1785219986.750349:0:14221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1785219986.772604:0:14221:0:(import.c:65:import_set_state_nolock()) ffff9cf36cda3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219986.772718:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2358:x1871938444174464:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 22498us (27803us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.772728:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:2.0:1785219986.776054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219986.776106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.776244:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174720 00000100:00100000:0.0:1785219986.776256:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174720 00000100:00100000:0.0:1785219986.776330:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174592 00000100:00100000:0.0:1785219986.776333:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174592 00000100:00100000:0.0:1785219986.776359:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1785219986.776398:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:13731:x1871938444174720:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785219986.776448:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785219986.776546:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:13731:x1871938444174720:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 151us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.776553:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1785219986.776570:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1785219986.776576:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:0:x1871938444174592:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785219986.776587:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785219986.776607:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:0:x1871938444174592:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.776613:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00080000:1.0:1785219986.777159:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219986.779798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.781639:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174848 00000100:00100000:0.0:1785219986.781668:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174848 00000100:00100000:0.0:1785219986.781735:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1785219986.781745:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:13731:x1871938444174848:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1785219986.781844:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:13731:x1871938444174848:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 101us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.781851:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1785219986.787401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.787445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219986.787475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219986.787620:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444174976 00000100:00100000:1.0:1785219986.787631:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444174976 00000100:00100000:1.0:1785219986.787707:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444175104 00000100:00100000:1.0:1785219986.787710:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444175104 00000100:00100000:2.0:1785219986.787782:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444175232 00000100:00100000:2.0:1785219986.787787:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444175232 00000100:00100000:0.0:1785219986.787823:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1785219986.787831:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1785219986.787834:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1871938444174976:12345-192.168.203.31@tcp:8:mount.lustre.0 00000100:00100000:2.0:1785219986.787842:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:13731:x1871938444175232:12345-192.168.203.31@tcp:33:mount.lustre.0 00010000:00080000:0.0:1785219986.787868:0:14855:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 22b52ba8-0ef2-43ea-b50a-dd369f8218e8@192.168.203.31@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1785219986.787899:0:14855:0:(genops.c:1406:class_connect()) connect: client 22b52ba8-0ef2-43ea-b50a-dd369f8218e8, cookie 0x8b38d407a078db35 00002000:00100000:0.0:1785219986.787913:0:14855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 22b52ba8-0ef2-43ea-b50a-dd369f8218e8/ffff9cf356474800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785219986.787938:0:14855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785219986.788317:0:14855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785219986.788347:0:14855:0:(import.c:65:import_set_state_nolock()) ffff9cf344b90000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219986.788438:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2358:x1871938444174976:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 606us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.788447:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:0.0:1785219986.788466:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1785219986.788470:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1871938444175104:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1785219986.788486:0:14855:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 22b52ba8-0ef2-43ea-b50a-dd369f8218e8@192.168.203.31@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1785219986.788504:0:14855:0:(genops.c:1406:class_connect()) connect: client 22b52ba8-0ef2-43ea-b50a-dd369f8218e8, cookie 0x8b38d407a078db3c 00002000:00100000:0.0:1785219986.788516:0:14855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 22b52ba8-0ef2-43ea-b50a-dd369f8218e8/ffff9cf344b97000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785219986.788531:0:14855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785219986.788674:0:14855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785219986.788692:0:14855:0:(import.c:65:import_set_state_nolock()) ffff9cf344b92800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219986.788718:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2358:x1871938444175104:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 245us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219986.788725:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000004:00080000:2.0:1785219986.788797:0:14222:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 895us 00000004:00200000:3.0:1785219986.820121:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1785219986.820404:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:13731:x1871938444175232:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 32520us (32967us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219986.820420:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1785219987.024728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219987.024827:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444175360 00000100:00100000:2.0:1785219987.024838:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444175360 00000100:00100000:2.0:1785219987.024899:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1785219987.024909:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:13777:x1871938444175360:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1785219987.024931:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219987.024957:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078db43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f736 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219987.025041:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078db4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219987.025055:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078db4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219987.025070:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078db4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219987.025276:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785219987.025280:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219987.025403:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078db4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219987.025431:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078db43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f736 expref: 8 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219987.025450:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078db4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f736 expref: 7 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219987.025459:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:2.0:1785219987.025461:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785219987.025465:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8c00, rc 0) 00000100:00100000:2.0:1785219987.025533:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:13777:x1871938444175360:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 625us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219987.025540:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00010000:00010000:0.0:1785219987.307675:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219987.371646:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785219987.371672:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465139072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785219987.371747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219987.371865:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139072 00000100:00100000:0.0:1785219987.371873:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139072 00000100:00100000:0.0:1785219987.371937:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785219987.371947:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465139072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785219987.371968:0:14857:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219987.372017:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465139072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219987.372024:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1785219987.372088:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219987.372124:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465139072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785219988.331741:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219988.397201:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465139200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785219988.397267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219988.397384:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139200 00000100:00100000:0.0:1785219988.397392:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139200 00000100:00100000:0.0:1785219988.397449:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785219988.397458:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465139200:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1785219988.398218:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1785219988.398573:0:14857:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219988.398639:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871938465139200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1181us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219988.398660:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785219988.398719:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465139200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785219988.400644:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465139456:0@lo:400:kworker.0 00000100:00100000:1.0:1785219988.400703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219988.400767:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139456 00000100:00100000:1.0:1785219988.400775:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139456 00000100:00100000:1.0:1785219988.400817:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219988.400825:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465139456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219988.400870:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465139456:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219988.400877:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785219988.400922:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465139456:0@lo:400:kworker.0 00000100:00100000:1.0:1785219988.400954:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465139584:0@lo:400:kworker.0 00000100:00100000:1.0:1785219988.400981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219988.401011:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139584 00000100:00100000:1.0:1785219988.401015:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139584 00000100:00100000:1.0:1785219988.401039:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785219988.401044:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465139584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219988.401076:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465139584:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219988.401081:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785219988.401104:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465139584:0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.406124:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465139712:0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.406213:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219988.406255:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785219988.406262:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465139328:0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.406302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219988.406329:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465139840:0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.406351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219988.406402:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139712 00000100:00100000:0.0:1785219988.406409:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139712 00000100:00100000:0.0:1785219988.406452:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139840 00000100:00100000:0.0:1785219988.406455:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139840 00000100:00100000:0.0:1785219988.406470:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219988.406935:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465139712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.407003:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871938465139712:12345-0@lo:400:kworker.0 Request processed in 524us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219988.407011:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785219988.407033:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785219988.407043:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465139840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.407078:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871938465139840:12345-0@lo:400:kworker.0 Request processed in 39us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219988.407085:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785219988.407131:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1871938465139840:0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.407154:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1871938465139712:0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.407205:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139328 00000100:00100000:0.0:1785219988.407210:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139328 00000100:00100000:0.0:1785219988.407242:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785219988.407249:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:3308:x1871938465139328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219988.407300:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:3308:x1871938465139328:12345-0@lo:400:kworker.0 Request processed in 52us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219988.407306:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785219988.407342:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465139328:0@lo:400:kworker.0 00000100:00080000:2.0:1785219988.412992:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1785219988.495656:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22b52ba8-0ef2-43ea-b50a-dd369f8218e8 00000001:00100000:3.0:1785219988.495672:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1785219988.495732:0:7492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1785219989.213122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.213234:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444175488 00000100:00100000:0.0:1785219989.213243:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444175488 00000100:00100000:0.0:1785219989.213321:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:0.0:1785219989.213332:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:13830:x1871938444175488:12345-192.168.203.31@tcp:41:lfs.0 00000004:00000024:0.0:1785219989.213425:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785219989.213497:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:13830:x1871938444175488:12345-192.168.203.31@tcp:41:lfs.0 Request processed in 167us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219989.213505:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00080000:2.0:1785219989.213837:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219989.217769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.217901:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444175616 00000100:00100000:0.0:1785219989.217914:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444175616 00000100:00100000:0.0:1785219989.217994:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1785219989.218004:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:13830:x1871938444175616:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:0.0:1785219989.218042:0:14857:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1785219989.218055:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219989.218147:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:13830:x1871938444175616:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 144us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219989.218155:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1785219989.220158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.220253:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444175744 00000100:00100000:2.0:1785219989.220262:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444175744 00000100:00100000:2.0:1785219989.220320:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1785219989.220330:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:13830:x1871938444175744:12345-192.168.203.31@tcp:13:lfs.0 00002000:00000024:2.0:1785219989.220354:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219989.220456:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:13830:x1871938444175744:12345-192.168.203.31@tcp:13:lfs.0 Request processed in 127us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.220465:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00080000:3.0:1785219989.220526:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785219989.355718:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219989.424490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219989.426211:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444175872 00000100:00100000:1.0:1785219989.426226:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444175872 00000100:00100000:1.0:1785219989.426433:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1785219989.426444:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+10:13861:x1871938444175872:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785219989.426462:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219989.426480:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf247675e00/0x8b38d407a078db51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f73d expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.426510:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf247675e00/0x8b38d407a078db51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f73d expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.426521:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf247675e00/0x8b38d407a078db51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f73d expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.426529:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf247675e00, rc 0) 00000100:00100000:1.0:1785219989.426600:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13861:x1871938444175872:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 158us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.426607:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 91 00000100:00100000:1.0:1785219989.448947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.449044:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176000 00000100:00100000:0.0:1785219989.449069:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176000 00000100:00100000:0.0:1785219989.449126:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:0.0:1785219989.449144:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13861:x1871938444176000:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785219989.449810:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13861:x1871938444176000:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 674us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219989.449819:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 92 00000100:00100000:3.0:1785219989.451864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.451961:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176128 00000100:00100000:2.0:1785219989.451970:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176128 00000100:00100000:2.0:1785219989.452026:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1785219989.452034:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13861:x1871938444176128:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785219989.452439:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13861:x1871938444176128:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 405us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.452447:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 93 00000100:00100000:2.0:1785219989.458799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219989.458925:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176256 00000100:00100000:1.0:1785219989.458934:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176256 00000100:00100000:1.0:1785219989.463420:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1785219989.463435:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13869:x1871938444176256:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785219989.463794:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13869:x1871938444176256:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 361us (5004us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.463803:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 94 00000100:00100000:1.0:1785219989.470773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.470866:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176384 00000100:00100000:0.0:1785219989.470879:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176384 00000100:00100000:0.0:1785219989.470931:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:0.0:1785219989.470940:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf36ced6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13869:x1871938444176384:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785219989.471215:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf36ced6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13869:x1871938444176384:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 275us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219989.471233:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 95 00000100:00100000:3.0:1785219989.473956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219989.474057:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176512 00000100:00100000:1.0:1785219989.474067:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176512 00000100:00100000:1.0:1785219989.474175:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:1.0:1785219989.474186:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13861:x1871938444176512:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785219989.474206:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219989.474236:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf247675c00/0x8b38d407a078db58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f767 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.474269:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf247675c00/0x8b38d407a078db58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f767 expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.474281:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf247675c00/0x8b38d407a078db58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f767 expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.474290:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf247675c00, rc 0) 00000100:00100000:1.0:1785219989.474432:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13861:x1871938444176512:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 248us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.474438:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 96 00000100:00100000:2.0:1785219989.483289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.483485:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176640 00000100:00100000:0.0:1785219989.483495:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176640 00000100:00100000:0.0:1785219989.483550:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:0.0:1785219989.483560:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13861:x1871938444176640:12345-192.168.203.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1785219989.483586:0:14211:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1785219989.483614:0:14211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1785219989.483619:0:14211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1785219989.483622:0:14211:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1785219989.483624:0:14211:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1785219989.485701:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13861:x1871938444176640:12345-192.168.203.31@tcp:256:mount.lustre.0 Request processed in 2134us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.485715:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 97 00000100:00100000:3.0:1785219989.488459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219989.488693:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176768 00000100:00100000:1.0:1785219989.488703:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176768 00000100:00100000:1.0:1785219989.488763:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:1.0:1785219989.488773:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13861:x1871938444176768:12345-192.168.203.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785219989.488790:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785219989.488808:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f76e expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.488836:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 13 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.488848:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 13 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219989.488857:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf247674000, rc 0) 00000100:00100000:1.0:1785219989.488906:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13861:x1871938444176768:12345-192.168.203.31@tcp:101:mount.lustre.0 Request processed in 135us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.488913:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 98 00000100:00100000:0.0:1785219989.492077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.492177:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444176896 00000100:00100000:2.0:1785219989.492187:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444176896 00000100:00100000:2.0:1785219989.492255:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:2.0:1785219989.492266:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13861:x1871938444176896:12345-192.168.203.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1785219989.492590:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13861:x1871938444176896:12345-192.168.203.31@tcp:501:mount.lustre.0 Request processed in 325us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.492599:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 99 00000100:00100000:0.0:1785219989.494694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.494809:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177024 00000100:00100000:2.0:1785219989.494818:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177024 00000100:00100000:2.0:1785219989.494905:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:2.0:1785219989.494916:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13861:x1871938444177024:12345-192.168.203.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785219989.495508:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13861:x1871938444177024:12345-192.168.203.31@tcp:503:mount.lustre.0 Request processed in 590us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.495518:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 100 00000100:00100000:0.0:1785219989.497874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219989.497978:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177152 00000100:00100000:1.0:1785219989.497986:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177152 00000100:00100000:1.0:1785219989.498149:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:1.0:1785219989.498160:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13874:x1871938444177152:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785219989.498589:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13874:x1871938444177152:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 430us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.498608:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 101 00000100:00100000:0.0:1785219989.501207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219989.502216:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177280 00000100:00100000:3.0:1785219989.502228:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177280 00000100:00100000:3.0:1785219989.502296:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:3.0:1785219989.502306:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13874:x1871938444177280:12345-192.168.203.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785219989.502587:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13874:x1871938444177280:12345-192.168.203.31@tcp:502:llog_process_th.0 Request processed in 281us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219989.502595:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 102 00000100:00100000:0.0:1785219989.521725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.522077:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177408 00000100:00100000:2.0:1785219989.522087:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177408 00000100:00100000:2.0:1785219989.522144:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1785219989.522152:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1871938444177408:12345-192.168.203.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1785219989.522185:0:14221:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 92b71284-157a-470c-8ec4-7c4d63f2d4c3@192.168.203.31@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1785219989.522291:0:14221:0:(genops.c:1406:class_connect()) connect: client 92b71284-157a-470c-8ec4-7c4d63f2d4c3, cookie 0x8b38d407a078db66 00000004:00100000:2.0:1785219989.522321:0:14221:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1785219989.522484:0:14221:0:(import.c:65:import_set_state_nolock()) ffff9cf34a8c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785219989.522571:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2358:x1871938444177408:12345-192.168.203.31@tcp:38:mount.lustre.0 Request processed in 417us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.522579:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1785219989.532496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.532532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.532658:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177664 00000100:00100000:2.0:1785219989.532669:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177664 00000100:00100000:1.0:1785219989.532670:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177536 00000100:00100000:1.0:1785219989.532674:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177536 00000100:00100000:1.0:1785219989.532767:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1785219989.532777:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+7:0:x1871938444177536:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1785219989.532810:0:14220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785219989.532876:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+7:0:x1871938444177536:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.532884:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1785219989.532901:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1785219989.532907:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:13861:x1871938444177664:12345-192.168.203.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1785219989.532918:0:14220:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785219989.532938:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:13861:x1871938444177664:12345-192.168.203.31@tcp:41:mount.lustre.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.532943:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00080000:3.0:1785219989.532998:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785219989.537750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.537859:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177792 00000100:00100000:2.0:1785219989.537868:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177792 00000100:00100000:2.0:1785219989.537946:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1785219989.537956:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:13861:x1871938444177792:12345-192.168.203.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1785219989.538053:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:13861:x1871938444177792:12345-192.168.203.31@tcp:40:mount.lustre.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.538061:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:2.0:1785219989.543428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.543699:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444177920 00000100:00100000:0.0:1785219989.543709:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444177920 00000100:00100000:0.0:1785219989.543798:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1785219989.543805:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1871938444177920:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1785219989.543834:0:14855:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 92b71284-157a-470c-8ec4-7c4d63f2d4c3@192.168.203.31@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1785219989.543876:0:14855:0:(genops.c:1406:class_connect()) connect: client 92b71284-157a-470c-8ec4-7c4d63f2d4c3, cookie 0x8b38d407a078db6d 00002000:00100000:0.0:1785219989.543886:0:14855:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 92b71284-157a-470c-8ec4-7c4d63f2d4c3/ffff9cf345ce1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785219989.543896:0:14855:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785219989.543996:0:14855:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785219989.544023:0:14855:0:(import.c:65:import_set_state_nolock()) ffff9cf345ce6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785219989.544092:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2358:x1871938444177920:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 286us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219989.544100:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1785219989.548083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.548559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219989.548761:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178176 00000100:00100000:0.0:1785219989.548771:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178176 00000100:00100000:0.0:1785219989.548823:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1785219989.548833:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:13861:x1871938444178176:12345-192.168.203.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1785219989.549126:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1785219989.549329:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:13861:x1871938444178176:12345-192.168.203.31@tcp:33:mount.lustre.0 Request processed in 496us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219989.549338:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1785219989.549564:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178048 00000100:00100000:1.0:1785219989.549570:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178048 00000100:00100000:1.0:1785219989.549645:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1785219989.549651:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1871938444178048:12345-192.168.203.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785219989.549677:0:14853:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 92b71284-157a-470c-8ec4-7c4d63f2d4c3@192.168.203.31@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1785219989.549705:0:14853:0:(genops.c:1406:class_connect()) connect: client 92b71284-157a-470c-8ec4-7c4d63f2d4c3, cookie 0x8b38d407a078db74 00002000:00100000:1.0:1785219989.549717:0:14853:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 92b71284-157a-470c-8ec4-7c4d63f2d4c3/ffff9cf3502f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cc ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785219989.549729:0:14853:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785219989.549939:0:14853:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785219989.549967:0:14853:0:(import.c:65:import_set_state_nolock()) ffff9cf3502f0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785219989.550006:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2358:x1871938444178048:12345-192.168.203.31@tcp:8:mount.lustre.0 Request processed in 353us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219989.550014:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1785219989.702578:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219989.702692:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178304 00000100:00100000:2.0:1785219989.702704:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178304 00000100:00100000:2.0:1785219989.702775:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1785219989.702787:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:13895:x1871938444178304:12345-192.168.203.31@tcp:101:mkdir.0 00010000:00010000:2.0:1785219989.702807:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219989.702829:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078db7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f798 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219989.702898:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219989.702911:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219989.702922:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785219989.703146:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785219989.703150:0:14219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1785219989.703234:0:14219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219989.703276:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9a00/0x8b38d407a078db7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 8 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219989.703295:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 7 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219989.703303:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:2.0:1785219989.703307:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785219989.703310:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8800, rc 0) 00000100:00100000:2.0:1785219989.703586:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+7:13895:x1871938444178304:12345-192.168.203.31@tcp:101:mkdir.0 Request processed in 800us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219989.703593:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00010000:00010000:0.0:1785219990.380073:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785219990.504413:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92b71284-157a-470c-8ec4-7c4d63f2d4c3 00000001:00100000:3.0:1785219990.504429:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22b52ba8-0ef2-43ea-b50a-dd369f8218e8 00010000:00010000:2.0:1785219991.403651:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785219992.081103:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 22b52ba8-0ef2-43ea-b50a-dd369f8218e8 00000001:00100000:0.0:1785219992.081130:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 92b71284-157a-470c-8ec4-7c4d63f2d4c3 00000001:02000400:2.0:1785219992.114732:0:16083:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1785219992.430358:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219992.493232:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785219992.493255:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465139968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219992.493328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219992.493991:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465139968 00000100:00100000:0.0:1785219992.494000:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465139968 00000100:00100000:0.0:1785219992.495465:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785219992.495479:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465139968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785219992.495520:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785219992.495605:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465139968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219992.495612:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785219992.495739:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465139968:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785219992.495824:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785219993.451887:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785219993.519180:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785219993.519205:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465140096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219993.519279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219993.520510:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465140096 00000100:00100000:3.0:1785219993.520523:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465140096 00000100:00100000:3.0:1785219993.520620:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785219993.520631:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465140096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785219993.520680:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219993.520753:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465140096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219993.520761:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1785219993.520784:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785219993.525054:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465140224:0@lo:400:kworker.0 00000100:00100000:3.0:1785219993.525153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219993.525429:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1785219993.525461:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465140096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785219993.525657:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465140224 00000100:00100000:1.0:1785219993.525664:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465140224 00000100:00100000:1.0:1785219993.525718:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1785219993.525727:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:3308:x1871938465140224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.526832:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465140352:0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.526883:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219993.526916:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785219993.526922:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465140736:0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.526943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219993.526968:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465140608:0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.526987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219993.527003:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785219993.527007:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465140480:0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.527024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219993.527047:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465140352 00000100:00100000:0.0:1785219993.527052:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465140352 00000100:00100000:0.0:1785219993.527087:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785219993.527094:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465140352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.527152:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465140352:12345-0@lo:400:kworker.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219993.527177:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785219993.527199:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465140736 00000100:00100000:0.0:1785219993.527203:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465140736 00000100:00100000:0.0:1785219993.527226:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465140608 00000100:00100000:0.0:1785219993.527228:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465140608 00000100:00100000:0.0:1785219993.527241:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465140480 00000100:00100000:0.0:1785219993.527243:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465140480 00000100:00100000:0.0:1785219993.527386:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785219993.527397:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465140736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.527429:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1871938465140736:12345-0@lo:400:kworker.0 Request processed in 35us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219993.527445:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785219993.527459:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785219993.527465:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465140608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.527493:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871938465140608:12345-0@lo:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219993.527498:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785219993.527509:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785219993.527514:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465140480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.527539:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871938465140480:12345-0@lo:400:kworker.0 Request processed in 24us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219993.527543:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785219993.527595:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1871938465140736:0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.527605:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465140352:0@lo:400:kworker.0 00000100:00080000:0.0:1785219993.527625:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219993.527793:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871938465140480:0@lo:400:kworker.0 00000100:00100000:0.0:1785219993.527803:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1871938465140608:0@lo:400:kworker.0 00000100:00100000:1.0:1785219993.531342:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:3308:x1871938465140224:12345-0@lo:400:kworker.0 Request processed in 5606us (6179us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219993.531358:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1785219993.532775:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19240113-729d-48ac-b4dd-0e1109961383:3308:1871938465140224:0@lo:400:kworker.0 00000001:00100000:3.0:1785219993.611713:0:7492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92b71284-157a-470c-8ec4-7c4d63f2d4c3 00010000:00010000:2.0:1785219994.482596:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219994.644791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219994.644842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219994.644969:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178432 00000100:00100000:3.0:1785219994.644991:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178432 00000100:00100000:3.0:1785219994.645055:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:0.0:1785219994.645080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219994.645119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219994.645138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219994.645157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219994.645619:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:2360:x1871938444178432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219994.645717:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:2360:x1871938444178432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 106us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219994.645727:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 104 00000100:00100000:0.0:1785219994.646633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219994.646800:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178688 00000100:00100000:0.0:1785219994.646810:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178688 00000100:00100000:0.0:1785219994.647609:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179200 00000100:00100000:0.0:1785219994.647618:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179200 00000100:00100000:0.0:1785219994.647652:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178816 00000100:00100000:0.0:1785219994.647655:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178816 00000100:00100000:0.0:1785219994.647667:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179072 00000100:00100000:0.0:1785219994.647669:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179072 00000100:00100000:0.0:1785219994.647689:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1785219994.647699:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444178688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219994.647792:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444178688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 94us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219994.647800:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:0.0:1785219994.647823:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:0.0:1785219994.647831:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444179200:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219994.647861:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444179200:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 31us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219994.647868:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00080000:3.0:1785219994.648081:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785219994.648087:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785219994.649438:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1785219994.649458:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444178816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219994.649728:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444178816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 277us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219994.649736:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:0.0:1785219994.649756:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1785219994.649765:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444179072:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219994.649795:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444179072:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 32us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219994.649801:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:0.0:1785219994.649830:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178944 00000100:00100000:0.0:1785219994.649840:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178944 00000100:00100000:1.0:1785219994.650968:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444178560 00000100:00100000:1.0:1785219994.650979:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444178560 00000100:00100000:0.0:1785219994.651095:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1785219994.651117:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2360:x1871938444178944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219994.651190:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2360:x1871938444178944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 73us (6107us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219994.651198:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00080000:3.0:1785219994.655657:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785219994.657443:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:1.0:1785219994.657460:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2360:x1871938444178560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219994.657582:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2360:x1871938444178560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 127us (12442us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219994.657590:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000040:00080000:2.0:1785219994.991847:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785219995.503719:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785219995.942320:0:16232:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffaf706180 20000000:00000080:1.0:1785219995.942345:0:16232:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf24703a000 uarg=0000000000000000 20000000:01000000:1.0:1785219995.942416:0:16232:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785219995.942423:0:16232:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785219995.942429:0:16232:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1785219995.944294:0:16233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1785219995.945779:0:16232:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1785219995.963316:0:16232:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1785219995.963436:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963484:0:16232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d879 expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963492:0:16232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 18 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963500:0:16232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963510:0:16232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963517:0:16232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963525:0:16232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963584:0:16232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963603:0:16232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 12 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219995.963621:0:16232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465140864:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219995.963805:0:16232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963814:0:16232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 12 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219995.963830:0:16232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465140992:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219995.963868:0:16232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963877:0:16232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 18 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219995.963887:0:16232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465141120:0@lo:104: 00000100:00100000:1.0:1785219995.963934:0:16232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785219995.963987:0:16232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 18 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.963995:0:16232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 18 pid: 14211 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219995.964002:0:16232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465141248:0@lo:104: 00000100:00100000:1.0:1785219995.964023:0:16232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219995.964057:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465141120 00000100:00100000:1.0:1785219995.964067:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465141120 00000100:00100000:3.0:1785219995.964070:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465141248 00000100:00100000:3.0:1785219995.964077:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465141248 00000100:00100000:3.0:1785219995.964141:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785219995.964154:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19240113-729d-48ac-b4dd-0e1109961383+4:16232:x1871938465141248:12345-0@lo:104: 00010000:00010000:3.0:1785219995.964172:0:14202:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219995.964239:0:14202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785219995.964246:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19240113-729d-48ac-b4dd-0e1109961383+4:16232:x1871938465141248:12345-0@lo:104: Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219995.964255:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785219995.966802:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785219995.966829:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+4:16232:x1871938465141120:12345-0@lo:104: 00010000:00010000:1.0:1785219995.966854:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.966983:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1785219995.966990:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+4:16232:x1871938465141120:12345-0@lo:104: Request processed in 176us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219995.967020:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1785219995.967125:0:16232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8b38d407a078d879 expref: 18 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967140:0:16232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8b38d407a078d879 expref: 18 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219995.967154:0:16232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465141376:0@lo:104: 00000100:00100000:1.0:1785219995.967199:0:16232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219995.967237:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1785219995.967249:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465141376 00000100:00100000:1.0:1785219995.967256:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465141376 00000100:00100000:1.0:1785219995.967279:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785219995.967284:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf2461f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+4:16232:x1871938465141376:12345-0@lo:104: 00010000:00010000:1.0:1785219995.967292:0:14203:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967330:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1785219995.967335:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf2461f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19240113-729d-48ac-b4dd-0e1109961383+4:16232:x1871938465141376:12345-0@lo:104: Request processed in 51us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219995.967341:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785219995.967389:0:16232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6000 going to sleep for 11 seconds 00000100:00100000:1.0:1785219995.967419:0:16232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465141120:0@lo:104: 00000100:00100000:1.0:1785219995.967428:0:16232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465141248:0@lo:104: 00000100:00100000:1.0:1785219995.967434:0:16232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465141376:0@lo:104: 00010000:00010000:1.0:1785219995.967475:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785219995.967482:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967497:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29600 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219995.967502:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967512:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219995.967519:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219995.967525:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785219995.967558:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967565:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219995.967593:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967601:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf348a29600/0x8b38d407a078d8c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d8cd expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967615:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785219995.967618:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967623:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219995.967626:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967642:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219995.967648:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219995.967653:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785219995.967669:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967674:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219995.967689:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967696:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf344f06000/0x8b38d407a078d9fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078da01 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967707:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785219995.967710:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967716:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf348a29e00 already unused, calling callback (ffffffffc1ba8c20) 10000000:00010000:1.0:1785219995.967719:0:14208:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967726:0:14208:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785219995.967732:0:14208:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785219995.967743:0:14208:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785219995.967755:0:14208:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967761:0:14208:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785219995.967767:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967773:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.131@tcp lock: ffff9cf348a29e00/0x8b38d407a078d879 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8b38d407a078d880 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.967788:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219995.967790:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219995.967809:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219995.967816:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219995.967929:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465141632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219995.967964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219995.967994:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785219995.967999:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465141760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219995.968017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219995.968043:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465141504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219995.968556:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785219995.973589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219995.973844:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465141632 00000100:00100000:2.0:1785219995.973856:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465141632 00010000:00010000:2.0:1785219995.973908:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 19 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219995.973934:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465141760 00000100:00100000:2.0:1785219995.973937:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465141760 00010000:00010000:2.0:1785219995.973950:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d879 expref: 20 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219995.973959:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465141504 00000100:00100000:2.0:1785219995.973962:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465141504 00010000:00010000:2.0:1785219995.973970:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 21 pid: 14211 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219995.973984:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785219995.973993:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+21:3306:x1871938465141632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219995.974012:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219995.974018:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 21 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974031:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 21 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974053:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3413cd400/0x8b38d407a078da01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078d9fa expref: 21 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974303:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219995.974485:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+20:3306:x1871938465141632:12345-0@lo:103:ldlm_bl.0 Request processed in 493us (6519us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219995.974515:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785219995.974537:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219995.974544:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+19:3306:x1871938465141760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219995.974554:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219995.974559:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d879 expref: 19 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974568:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078d879 expref: 19 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974581:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078d880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078d879 expref: 19 pid: 14213 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974590:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219995.974615:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+18:3306:x1871938465141760:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (6597us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219995.974622:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785219995.974634:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785219995.974640:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+17:3309:x1871938465141504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785219995.974650:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219995.974654:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 17 pid: 14211 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974663:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 17 pid: 14211 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974673:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf344f07600/0x8b38d407a078d8cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8b38d407a078d8c6 expref: 17 pid: 14211 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.974693:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219995.974714:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19240113-729d-48ac-b4dd-0e1109961383+16:3309:x1871938465141504:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219995.974720:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785219995.974819:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465141504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785219995.975009:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465141632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785219995.975024:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465141760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785219995.980928:0:16232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465140864:192.168.203.31@tcp:104: 00000100:00100000:1.0:1785219995.980946:0:16232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16232:1871938465140992:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785219995.980996:0:16232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219995.984898:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219995.985052:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219995.986120:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179456 00000100:00100000:2.0:1785219995.986137:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179456 00010000:00010000:2.0:1785219995.986579:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 13 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219995.986627:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179328 00000100:00100000:2.0:1785219995.986631:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179328 00010000:00010000:2.0:1785219995.986647:0:14204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 14 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219995.986665:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1785219995.986675:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+14:2362:x1871938444179456:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219995.986695:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219995.986702:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 14 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.986715:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 14 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.986737:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf247674600/0x8b38d407a078db27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f70c expref: 14 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.986849:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785219995.987040:0:14205:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1785219995.987053:0:14205:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1785219995.987612:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:2362:x1871938444179456:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 934us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219995.987624:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1785219995.987649:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1785219995.987658:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:2362:x1871938444179328:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785219995.987671:0:14204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785219995.987679:0:14204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 12 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987691:0:14204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 12 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987706:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf247674000/0x8b38d407a078db5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f76e expref: 12 pid: 14214 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987723:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987733:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987750:0:14204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987758:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987868:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987875:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987882:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785219995.987887:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.987896:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.989765:0:16232:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.989766:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.989784:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219995.989791:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf247675a00/0x8b38d407a078db89 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219995.989794:0:14204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785219995.989887:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:2362:x1871938444179328:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 2223us (4827us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219995.989898:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00010000:00010000:1.0:1785219996.523594:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785219997.548951:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785219997.611491:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785219997.611501:0:14216:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf244b37800 from 10 10000000:01000000:2.0:1785219997.611507:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785219997.611587:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9a00/0x8b38d407a078db90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219997.611602:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9a00/0x8b38d407a078db90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219997.611615:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9a00/0x8b38d407a078db90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785219997.611657:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465141888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785219997.611695:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785219997.611715:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465142016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219997.611764:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219997.611772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219997.612133:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465141888 00000100:00100000:0.0:1785219997.612143:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465141888 00000100:00100000:2.0:1785219997.612219:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf381b78780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219997.612230:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1785219997.612243:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+16:14216:x1871938465141888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219997.612264:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219997.612285:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078db97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078db90 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.612319:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078db97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078db90 expref: 17 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.612332:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b1000/0x8b38d407a078db97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078db90 expref: 17 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.612350:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1000, rc 0) 00000100:00100000:0.0:1785219997.612453:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+17:14216:x1871938465141888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219997.612462:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1785219997.612541:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465141888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219997.612561:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9a00/0x8b38d407a078db90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078db97 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.612571:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9a00/0x8b38d407a078db90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078db97 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219997.612661:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381171180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219997.612691:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219997.612711:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf381703840 going to sleep for 11 seconds 00000100:00100000:3.0:1785219997.612873:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142016 00000100:00100000:3.0:1785219997.612878:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142016 00000100:00100000:2.0:1785219997.612936:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142144 00000100:00100000:3.0:1785219997.612937:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785219997.612943:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142144 00000100:00100000:3.0:1785219997.612949:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465142016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219997.612979:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1785219997.612988:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+17:14216:x1871938465142144:12345-0@lo:501:ll_cfg_requeue.0 00002000:00000024:3.0:1785219997.612991:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785219997.613046:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465142016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219997.613054:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785219997.613108:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465142016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785219997.613439:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+17:14216:x1871938465142144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 451us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219997.613448:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1785219997.613859:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785219997.614134:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381171180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.614192:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.614253:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219997.614296:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351f1f180 going to sleep for 11 seconds 00000100:00100000:1.0:1785219997.614337:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142272 00000100:00100000:1.0:1785219997.614346:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142272 00000100:00100000:1.0:1785219997.614415:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1785219997.614425:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+17:14216:x1871938465142272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219997.614651:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+17:14216:x1871938465142272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219997.614659:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1785219997.614987:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1785219997.615966:0:16284:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1785219997.616038:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1785219997.616853:0:14216:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219997.616873:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9a00/0x8b38d407a078db90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078db97 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.616888:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf37edc9a00/0x8b38d407a078db90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078db97 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219997.616901:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785219997.616905:0:14216:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf3486ee000 from 10 10000000:01000000:3.0:1785219997.616909:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785219997.616964:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06400/0x8b38d407a078db9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.616981:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f06400/0x8b38d407a078db9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.616996:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f06400/0x8b38d407a078db9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219997.617027:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.618423:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219997.618492:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351f1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1785219997.620133:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142400 00000100:00100000:0.0:1785219997.620163:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142400 00000100:00100000:0.0:1785219997.620243:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1785219997.620257:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+17:14216:x1871938465142400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219997.620282:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219997.620308:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b0000/0x8b38d407a078dba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078db9e expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.620349:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b0000/0x8b38d407a078dba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078db9e expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.620382:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b0000/0x8b38d407a078dba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078db9e expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.620394:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0000, rc 0) 00000100:00100000:0.0:1785219997.620497:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:14216:x1871938465142400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219997.621241:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1785219997.621344:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219997.621391:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f06400/0x8b38d407a078db9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078dba5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219997.621421:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f06400/0x8b38d407a078db9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078dba5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219997.621636:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219997.621690:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219997.621740:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf381703f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785219997.622067:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142528 00000100:00100000:3.0:1785219997.622074:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142528 00000100:00100000:3.0:1785219997.622130:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1785219997.622139:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3717f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+18:14216:x1871938465142528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.622640:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3717f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+18:14216:x1871938465142528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 501us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219997.622649:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1785219997.622919:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785219997.622984:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785219997.623034:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219997.623073:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf381703f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785219997.623130:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142656 00000100:00100000:1.0:1785219997.623136:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142656 00000100:00100000:1.0:1785219997.623170:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1785219997.623178:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:14216:x1871938465142656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785219997.623580:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+18:14216:x1871938465142656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 402us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219997.623594:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785219997.631654:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1785219997.634064:0:16286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1785219997.640519:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1785219997.640572:0:14216:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219997.640591:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f06400/0x8b38d407a078db9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078dba5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.640609:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f06400/0x8b38d407a078db9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078dba5 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785219997.640622:0:14216:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785219997.640635:0:14216:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9cf356ac9800 from 10 10000000:01000000:3.0:1785219997.640639:0:14216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785219997.640692:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078dbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.640701:0:14216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078dbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.640715:0:14216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078dbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785219997.642220:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.642324:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219997.642465:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351f1f180 going to sleep for 11 seconds 00000100:00100000:1.0:1785219997.656648:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142784 00000100:00100000:1.0:1785219997.656670:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142784 00000100:00100000:2.0:1785219997.657355:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1785219997.657384:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+18:14216:x1871938465142784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785219997.657408:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785219997.657434:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078dbb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8b38d407a078dbac expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219997.657474:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078dbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8b38d407a078dbac expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219997.657511:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf37edc9c00/0x8b38d407a078dbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8b38d407a078dbac expref: 19 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785219997.657524:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9c00, rc 0) 00000100:00100000:2.0:1785219997.658064:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:14216:x1871938465142784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 696us (15737us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219997.658074:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785219997.658224:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785219997.658250:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078dbac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078dbb3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785219997.658265:0:14216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078dbac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8b38d407a078dbb3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785219997.658358:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219997.658425:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219997.658476:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351fb6840 going to sleep for 11 seconds 00000100:00100000:2.0:1785219997.658877:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465142912 00000100:00100000:2.0:1785219997.658886:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465142912 00000100:00100000:2.0:1785219997.659238:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1785219997.659248:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:14216:x1871938465142912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.660746:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465142912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.660816:0:14216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465143040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.660879:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219997.660917:0:14216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351f1fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1785219997.660944:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143040 00000100:00100000:3.0:1785219997.660951:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143040 00000100:00100000:3.0:1785219997.660992:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785219997.661003:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+20:14216:x1871938465143040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.661232:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19240113-729d-48ac-b4dd-0e1109961383+20:14216:x1871938465143040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219997.661240:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785219997.661291:0:14216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19240113-729d-48ac-b4dd-0e1109961383:14216:1871938465143040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219997.661348:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:14216:x1871938465142912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1249us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219997.661359:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000040:00080000:2.0:1785219997.667886:0:16288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1785219997.670519:0:14216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1785219997.670583:0:14216:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785219997.670600:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078dbac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078dbb3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.670617:0:14216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.131@tcp lock: ffff9cf344f07000/0x8b38d407a078dbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8b38d407a078dbb3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785219997.969506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219997.969608:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179584 00000100:00100000:3.0:1785219997.969621:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179584 00000100:00100000:3.0:1785219997.969695:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:3.0:1785219997.969709:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+11:13745:x1871938444179584:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785219997.969732:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785219997.969756:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078dbba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f79f expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.969794:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078dbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f79f expref: 12 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.969808:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf344f07a00/0x8b38d407a078dbba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f79f expref: 12 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785219997.969819:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07a00, rc 0) 00000100:00100000:3.0:1785219997.969895:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13745:x1871938444179584:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 189us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219997.969902:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 114 00000100:00100000:0.0:1785219997.974794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785219997.974970:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179712 00000100:00100000:3.0:1785219997.974984:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179712 00000100:00100000:3.0:1785219997.975055:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:3.0:1785219997.975067:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13745:x1871938444179712:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785219997.975955:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13745:x1871938444179712:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 886us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1785219997.975966:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 115 00000100:00100000:1.0:1785219997.987765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219997.990329:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179840 00000100:00100000:2.0:1785219997.990349:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179840 00000100:00100000:2.0:1785219997.990619:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:2.0:1785219997.990631:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13745:x1871938444179840:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219997.991001:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13745:x1871938444179840:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 370us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219997.991013:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 116 00000100:00100000:1.0:1785219998.002887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219998.003005:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444179968 00000100:00100000:0.0:1785219998.003019:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444179968 00000100:00100000:0.0:1785219998.003096:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:0.0:1785219998.003108:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+12:13745:x1871938444179968:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785219998.003131:0:14211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785219998.003154:0:14211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf3489b1600/0x8b38d407a078dbc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7a6 expref: -99 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219998.003191:0:14211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf3489b1600/0x8b38d407a078dbc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7a6 expref: 13 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219998.003206:0:14211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf3489b1600/0x8b38d407a078dbc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7a6 expref: 13 pid: 14211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785219998.003218:0:14211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1600, rc 0) 00000100:00100000:0.0:1785219998.003301:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13745:x1871938444179968:12345-192.168.203.31@tcp:101:ll_cfg_requeue.0 Request processed in 194us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219998.003310:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 117 00000100:00100000:0.0:1785219998.005992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785219998.006097:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180096 00000100:00100000:1.0:1785219998.006110:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180096 00000100:00100000:1.0:1785219998.006184:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1785219998.006197:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13745:x1871938444180096:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785219998.010249:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13745:x1871938444180096:12345-192.168.203.31@tcp:501:ll_cfg_requeue.0 Request processed in 4039us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219998.010270:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 118 00000100:00100000:1.0:1785219998.021398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219998.021496:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180224 00000100:00100000:2.0:1785219998.021510:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180224 00000100:00100000:2.0:1785219998.021575:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 119 00000100:00100000:2.0:1785219998.021588:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf377bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13745:x1871938444180224:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785219998.021905:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf377bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:13745:x1871938444180224:12345-192.168.203.31@tcp:503:ll_cfg_requeue.0 Request processed in 312us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219998.021914:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 119 00010000:00010000:3.0:1785219998.571669:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785219998.636080:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465143168:0@lo:400:kworker.0 00000100:00100000:3.0:1785219998.636175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219998.636245:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465143680:0@lo:400:kworker.0 00000100:00100000:3.0:1785219998.636274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785219998.636299:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785219998.636305:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465143552:0@lo:400:kworker.0 00000100:00100000:3.0:1785219998.636329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219998.636464:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143168 00000100:00100000:1.0:1785219998.636473:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143168 00000100:00100000:1.0:1785219998.636539:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1785219998.636549:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf34a9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:3309:x1871938465143168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219998.636617:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf34a9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19240113-729d-48ac-b4dd-0e1109961383+19:3309:x1871938465143168:12345-0@lo:400:kworker.0 Request processed in 70us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219998.636625:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1785219998.636660:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143680 00000100:00100000:1.0:1785219998.636664:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143680 00000100:00100000:1.0:1785219998.636695:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143552 00000100:00100000:1.0:1785219998.636698:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143552 00000100:00100000:1.0:1785219998.636714:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785219998.636720:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465143680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219998.636754:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1871938465143680:12345-0@lo:400:kworker.0 Request processed in 34us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219998.636760:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785219998.637318:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19240113-729d-48ac-b4dd-0e1109961383:3309:1871938465143168:0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.637336:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1871938465143680:0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.637395:0:14221:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1785219998.637406:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465143296:0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.637414:0:14221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1785219998.637452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785219998.637513:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465143808:0@lo:400:kworker.0 00000100:00100000:0.0:1785219998.637538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785219998.637695:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143808 00000100:00100000:1.0:1785219998.637699:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143808 00000100:00100000:1.0:1785219998.637723:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785219998.637730:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465143552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.638239:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143296 00000100:00100000:2.0:1785219998.638244:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143296 00000100:00100000:2.0:1785219998.638276:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785219998.638283:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465143296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.638324:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871938465143296:12345-0@lo:400:kworker.0 Request processed in 41us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219998.638332:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785219998.638396:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785219998.638404:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465143808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.638433:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871938465143808:12345-0@lo:400:kworker.0 Request processed in 32us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219998.638439:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1785219998.638472:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785219998.638489:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465143424:0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.638517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219998.638535:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465143936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785219998.638584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785219998.638616:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143936 00000100:00100000:2.0:1785219998.638621:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143936 00000100:00100000:2.0:1785219998.638653:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785219998.638660:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465143936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785219998.638688:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785219998.638728:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465143936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219998.638734:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785219998.638860:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1871938465143552:12345-0@lo:400:kworker.0 Request processed in 1128us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219998.638869:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785219998.638910:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1871938465143552:0@lo:400:kworker.0 00000100:00100000:1.0:1785219998.638943:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465143424 00000100:00100000:1.0:1785219998.638947:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465143424 00000100:00100000:1.0:1785219998.638973:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785219998.638980:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465143424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785219998.639014:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465143424:12345-0@lo:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219998.639031:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785219998.639275:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1871938465143296:0@lo:400:kworker.0 00000100:00100000:0.0:1785219998.639293:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1871938465143808:0@lo:400:kworker.0 00000100:00080000:2.0:1785219998.639749:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785219998.639897:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465143424:0@lo:400:kworker.0 00000100:00100000:2.0:1785219998.639918:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465143936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785219999.595645:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785219999.762868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219999.762972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219999.763005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219999.763037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219999.763059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219999.763090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785219999.763135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785219999.763149:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180864 00000100:00100000:2.0:1785219999.763166:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180864 00000100:00100000:0.0:1785219999.763171:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180608 00000100:00100000:1.0:1785219999.763178:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444181120 00000100:00100000:0.0:1785219999.763179:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180608 00000100:00100000:1.0:1785219999.763199:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444181120 00000100:00100000:2.0:1785219999.763264:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180480 00000100:00100000:0.0:1785219999.763270:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180736 00000100:00100000:2.0:1785219999.763271:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180480 00000100:00100000:1.0:1785219999.763276:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180992 00000100:00100000:0.0:1785219999.763278:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180736 00000100:00100000:1.0:1785219999.763285:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180992 00000100:00100000:2.0:1785219999.763332:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:0.0:1785219999.763332:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1785219999.763359:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2359:x1871938444180864:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219999.763361:0:14856:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1785219999.763424:0:14856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1785219999.763454:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1785219999.763470:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:1.0:1785219999.763485:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2359:x1871938444181120:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785219999.763510:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2359:x1871938444180864:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 161us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1785219999.763521:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:2.0:1785219999.763551:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:2.0:1785219999.763559:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2359:x1871938444180480:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219999.763586:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2359:x1871938444181120:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 102us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219999.763597:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:2.0:1785219999.763604:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2359:x1871938444180480:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 41us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219999.763624:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1785219999.763634:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1785219999.763640:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1785219999.763657:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2359:x1871938444180736:12345-192.168.203.31@tcp:400:kworker.0 00000100:00080000:2.0:1785219999.763674:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785219999.763681:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785219999.763685:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785219999.763822:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2359:x1871938444180608:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:1.0:1785219999.763894:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2359:x1871938444180736:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 242us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219999.763904:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1785219999.763922:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1785219999.763929:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:1.0:1785219999.763935:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2359:x1871938444180992:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:3.0:1785219999.764252:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444180352 00000100:00100000:3.0:1785219999.764261:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444180352 00000100:00100000:3.0:1785219999.764305:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:3.0:1785219999.764314:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf34a9a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:2359:x1871938444180352:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785219999.765198:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2359:x1871938444180608:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 1847us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1785219999.765209:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:3.0:1785219999.767354:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf34a9a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:2359:x1871938444180352:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3019us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219999.767354:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2359:x1871938444180992:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 3396us (4199us total) trans 0 rc 0/0 00000100:00100000:1.0:1785219999.767410:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:3.0:1785219999.767416:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 121 00000100:00100000:0.0:1785220000.137627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.141523:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444181248 00000100:00100000:2.0:1785220000.141547:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444181248 00000100:00100000:2.0:1785220000.141735:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:2.0:1785220000.141749:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:14405:x1871938444181248:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785220000.141779:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220000.141810:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dbc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7ad expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.141948:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.141978:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.141993:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.142014:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.142022:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.142029:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.144807:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078dbdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.144836:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078dbdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.144850:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078dbdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785220000.149743:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1785220000.149760:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785220000.150540:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078dbdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150579:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150587:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150596:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150603:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.150608:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150617:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150639:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:2.0:1785220000.150643:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220000.150648:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150655:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dbcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150670:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150676:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150682:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150694:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.150698:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150704:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150714:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cf345fcd900) 00010000:00010000:2.0:1785220000.150717:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220000.150720:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150726:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dbd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150786:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dbc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7ad expref: 8 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150804:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9200/0x8b38d407a078dbdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7ad expref: 7 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.150812:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf345fcd700) 00010000:00010000:2.0:1785220000.150815:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785220000.150817:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9200, rc 0) 00000100:00100000:2.0:1785220000.152959:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:14405:x1871938444181248:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 11197us (15331us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220000.154200:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:0.0:1785220000.164704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.171672:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444181504 00000100:00100000:2.0:1785220000.171720:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444181504 00000100:00100000:3.0:1785220000.174558:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1785220000.174599:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:14405:x1871938444181504:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785220000.174636:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220000.174679:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dbe4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7b4 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.174797:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.174835:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.174852:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.180655:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.180683:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.180696:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.181565:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07e00/0x8b38d407a078dbf9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.181577:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07e00/0x8b38d407a078dbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.181586:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07e00/0x8b38d407a078dbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785220000.181597:0:16345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1785220000.182257:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182267:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182272:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182285:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f07600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785220000.182290:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182298:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182312:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf345fcd700) 00010000:00010000:3.0:1785220000.182315:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785220000.182320:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182467:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dbeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182482:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182488:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182495:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182500:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785220000.182503:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182509:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182529:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf356788c00) 00010000:00010000:3.0:1785220000.182531:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785220000.182535:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.182541:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dbf2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.183806:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dbe4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7b4 expref: 10 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.183830:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07e00/0x8b38d407a078dbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7b4 expref: 9 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.183840:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788d00) 00010000:00010000:3.0:1785220000.183843:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785220000.183845:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07e00, rc 0) 00000100:00100000:3.0:1785220000.183927:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14405:x1871938444181504:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 9350us (19239us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1785220000.183935:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:1.0:1785220000.193724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.194078:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444181632 00000100:00100000:0.0:1785220000.194088:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444181632 00000100:00100000:0.0:1785220000.194150:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1785220000.194162:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14405:x1871938444181632:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1785220000.194290:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14405:x1871938444181632:12345-192.168.203.31@tcp:59:lhsmtool_posix.0 Request processed in 130us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220000.194299:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:1.0:1785220000.219996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.220849:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444181760 00000100:00100000:2.0:1785220000.220860:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444181760 00000100:00100000:2.0:1785220000.220982:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:2.0:1785220000.220993:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14411:x1871938444181760:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785220000.221013:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220000.221033:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7bb expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221108:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221122:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221133:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221147:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221154:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221161:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221462:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221470:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221488:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221494:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.221498:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221506:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221517:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:2.0:1785220000.221521:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220000.221525:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221531:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221544:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221549:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221554:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221558:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.221560:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221575:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221582:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf345fcd900) 00010000:00010000:2.0:1785220000.221584:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220000.221587:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221593:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221624:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7bb expref: 10 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221634:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:2.0:1785220000.221637:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220000.221640:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7bb expref: 10 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.221649:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9000, rc 0) 00000100:00100000:2.0:1785220000.221717:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14411:x1871938444181760:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 725us (1730us total) trans 0 rc 301/301 00000100:00100000:2.0:1785220000.221734:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:1.0:1785220000.228822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.231634:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444181888 00000100:00100000:0.0:1785220000.231650:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444181888 00000100:00100000:0.0:1785220000.231776:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1785220000.231789:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14411:x1871938444181888:12345-192.168.203.31@tcp:700:lfs.0 00000100:00100000:0.0:1785220000.231889:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14411:x1871938444181888:12345-192.168.203.31@tcp:700:lfs.0 Request processed in 103us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220000.231897:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:3.0:1785220000.241572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.241625:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444182144 00000100:00100000:3.0:1785220000.241636:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444182144 00000100:00100000:3.0:1785220000.241689:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:3.0:1785220000.241699:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14411:x1871938444182144:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1785220000.241758:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785220000.241789:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078db4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f736 expref: 9 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.241822:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:3.0:1785220000.241828:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785220000.242115:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.242129:0:14220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 5 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.242137:0:14220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.242170:0:14220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 5 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.242881:0:14220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 5 pid: 14219 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220000.242900:0:14220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14220:1871938465144064:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785220000.243297:0:14220:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350320900 going to sleep for 11 seconds 00000100:00100000:3.0:1785220000.250912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.251076:0:14220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14220:1871938465144064:192.168.203.31@tcp:104: 00010000:00010000:0.0:1785220000.251108:0:14220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220000.251131:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444182272 00000100:00100000:1.0:1785220000.251139:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444182272 00010000:00010000:1.0:1785220000.251183:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 6 pid: 14219 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220000.251230:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:1.0:1785220000.251250:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2362:x1871938444182272:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785220000.251268:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785220000.251275:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 6 pid: 14219 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220000.251289:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 6 pid: 14219 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220000.251315:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078db82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f798 expref: 6 pid: 14219 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220000.251333:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:1.0:1785220000.251338:0:14206:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220000.251348:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220000.251355:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220000.251426:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785220000.251477:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2362:x1871938444182272:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 238us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1785220000.251485:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00010000:00010000:0.0:1785220000.251604:0:14220:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.251612:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.251640:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.251650:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.251659:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785220000.253459:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1785220000.253477:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.253487:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.253494:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.253501:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220000.253505:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.253512:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.253527:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf345fcd600) 00010000:00010000:0.0:1785220000.253530:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220000.253534:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.253540:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785220000.253558:0:14220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073dc1e90 reply state 00000000ec1810e1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220000.253566:0:14220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785220000.253664:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+10:14411:x1871938444182144:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 11963us (12096us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1785220000.253682:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00010000:00010000:0.0:1785220000.259497:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.259514:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.259522:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.259529:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220000.259533:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.259541:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.259558:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf34a441700) 00010000:00010000:0.0:1785220000.259561:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220000.259565:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.259571:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc23 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220000.392472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.392566:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444182400 00000100:00100000:3.0:1785220000.392577:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444182400 00000100:00100000:3.0:1785220000.392639:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1785220000.392650:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:14419:x1871938444182400:12345-192.168.203.31@tcp:101:lctl.0 00010000:00010000:3.0:1785220000.392675:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220000.392700:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7c2 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.392785:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dc31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.392800:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dc31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.392810:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dc31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785220000.392873:0:16345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785220000.392877:0:16345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1785220000.392914:0:16345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dc31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.392937:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7c2 expref: 11 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.392954:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f07600/0x8b38d407a078dc31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7c2 expref: 10 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.392962:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:3.0:1785220000.392965:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785220000.392968:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f07600, rc 0) 00000100:00100000:3.0:1785220000.393030:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+10:14419:x1871938444182400:12345-192.168.203.31@tcp:101:lctl.0 Request processed in 383us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220000.393037:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 20 00000100:00100000:3.0:1785220000.423335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.423799:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444182528 00000100:00100000:0.0:1785220000.423808:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444182528 00000100:00100000:0.0:1785220000.423877:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:0.0:1785220000.423888:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:14420:x1871938444182528:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785220000.423910:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785220000.423946:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7c9 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.424016:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078dc3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.424030:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078dc3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.424042:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078dc3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785220000.424131:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785220000.424135:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1785220000.424158:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078dc3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.424184:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7c9 expref: 7 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.424515:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1800/0x8b38d407a078dc3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7c9 expref: 6 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.424526:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:0.0:1785220000.424529:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785220000.424533:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1800, rc 0) 00000100:00100000:0.0:1785220000.424598:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:14420:x1871938444182528:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 711us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220000.424605:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 21 00000100:00100000:1.0:1785220000.433016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.433403:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444182656 00000100:00100000:2.0:1785220000.433414:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444182656 00000100:00100000:2.0:1785220000.433513:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:2.0:1785220000.433524:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:14420:x1871938444182656:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785220000.433560:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220000.433581:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7d0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433645:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433659:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433669:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433683:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433690:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433696:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433822:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078dc5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433831:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078dc5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433837:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078dc5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785220000.433880:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1785220000.433890:0:14219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785220000.433920:0:14219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078dc5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433934:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433940:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433948:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433954:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.433959:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433966:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433977:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:2.0:1785220000.433981:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220000.433985:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.433991:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dc4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434004:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434009:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434026:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434031:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.434034:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434041:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434071:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf345fcd900) 00010000:00010000:2.0:1785220000.434074:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220000.434076:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434082:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dc54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434113:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7d0 expref: 8 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434125:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078dc5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7d0 expref: 7 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.434132:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf345fcd800) 00010000:00010000:2.0:1785220000.434134:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785220000.434137:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8200, rc 0) 00000100:00100000:2.0:1785220000.434966:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+7:14420:x1871938444182656:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 687us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220000.434986:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 22 00000100:00100000:1.0:1785220000.439079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.439279:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444182912 00000100:00100000:2.0:1785220000.439289:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444182912 00000100:00100000:2.0:1785220000.439508:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:2.0:1785220000.439519:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+7:14420:x1871938444182912:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785220000.439539:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220000.439559:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7d7 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785220000.439682:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785220000.439806:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7d7 expref: 9 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.439821:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:2.0:1785220000.439824:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785220000.439830:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dc62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7d7 expref: 9 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.439843:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9000, rc 0) 00000100:00100000:2.0:1785220000.439893:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+8:14420:x1871938444182912:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 378us (840us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1785220000.439900:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 23 00000100:00100000:1.0:1785220000.443694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.443779:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444183168 00000100:00100000:3.0:1785220000.443806:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444183168 00000100:00100000:3.0:1785220000.443865:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 24 00000100:00100000:3.0:1785220000.443874:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+8:14420:x1871938444183168:12345-192.168.203.31@tcp:36:lfs.0 00010000:00010000:3.0:1785220000.443933:0:16345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785220000.443961:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8200/0x8b38d407a078dc5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7d0 expref: 8 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.443979:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf345fcd800) 00010000:00010000:3.0:1785220000.443989:0:16345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785220000.444012:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.444024:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.444033:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785220000.444270:0:16345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5e0692b reply state 000000002119ca90 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220000.444280:0:16345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785220000.444294:0:16345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1785220000.444426:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+9:14420:x1871938444183168:12345-192.168.203.31@tcp:36:lfs.0 Request processed in 553us (740us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1785220000.444433:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 24 00010000:00010000:2.0:1785220000.446915:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.446932:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.446956:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.446962:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.446967:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.446976:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.446991:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf356788200) 00010000:00010000:2.0:1785220000.446994:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1785220000.446999:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.447005:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc70 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220000.449450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.449662:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444183424 00000100:00100000:0.0:1785220000.449685:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444183424 00000100:00100000:0.0:1785220000.449738:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1785220000.449747:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+8:14420:x1871938444183424:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:0.0:1785220000.450007:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+9:14420:x1871938444183424:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 260us (566us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1785220000.450015:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785220000.453781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.453943:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444183680 00000100:00100000:0.0:1785220000.453953:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444183680 00000100:00100000:0.0:1785220000.454009:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:0.0:1785220000.454018:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+9:14420:x1871938444183680:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:0.0:1785220000.454042:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785220000.454079:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7de expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454322:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454336:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454346:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454360:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454413:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454420:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785220000.454554:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1785220000.454648:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454656:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454663:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454668:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220000.454672:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454681:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454691:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:0.0:1785220000.454694:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220000.454698:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454704:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dc7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454720:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454726:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454742:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454747:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220000.454750:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454756:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454762:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf34a441700) 00010000:00010000:0.0:1785220000.454764:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220000.454767:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454772:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dc85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454807:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7de expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454817:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:0.0:1785220000.454819:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785220000.454822:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dc77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7de expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.454831:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0800, rc 0) 00000100:00100000:0.0:1785220000.454879:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92b71284-157a-470c-8ec4-7c4d63f2d4c3+10:14420:x1871938444183680:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 863us (1108us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1785220000.454894:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 25 00000100:00100000:1.0:1785220000.458932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.459012:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444183808 00000100:00100000:3.0:1785220000.459021:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444183808 00000100:00100000:3.0:1785220000.459097:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:3.0:1785220000.459107:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+10:14420:x1871938444183808:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:3.0:1785220000.459157:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220000.459181:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7e5 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.459285:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.459301:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.459314:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785220000.459414:0:16345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1785220000.459418:0:16345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785220000.459443:0:16345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.459470:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dc93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 12 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.459489:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 11 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.459497:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785220000.459500:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785220000.459503:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf344f06c00, rc 0) 00000100:00100000:3.0:1785220000.459557:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+11:14420:x1871938444183808:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 451us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220000.459563:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 26 00000100:00100000:1.0:1785220000.465023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.465199:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444183936 00000100:00100000:0.0:1785220000.465219:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444183936 00000100:00100000:0.0:1785220000.465276:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:0.0:1785220000.465286:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+11:14420:x1871938444183936:12345-192.168.203.31@tcp:37:lfs.0 00000100:00100000:0.0:1785220000.474928:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92b71284-157a-470c-8ec4-7c4d63f2d4c3+11:14420:x1871938444183936:12345-192.168.203.31@tcp:37:lfs.0 Request processed in 9631us (9902us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220000.474943:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1785220000.480298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.480491:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444184192 00000100:00100000:3.0:1785220000.480502:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444184192 00000100:00100000:3.0:1785220000.480566:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:3.0:1785220000.480577:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351904450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+11:14420:x1871938444184192:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1785220000.480850:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351904450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+12:14420:x1871938444184192:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 274us (561us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1785220000.480858:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1785220000.540023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.540780:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444184320 00000100:00100000:0.0:1785220000.540794:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444184320 00000100:00100000:0.0:1785220000.540864:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:0.0:1785220000.540875:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+10:14426:x1871938444184320:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:0.0:1785220000.540906:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785220000.540928:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7ec expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541011:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541029:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541042:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541478:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541510:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541518:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541665:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078dcb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541675:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541684:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785220000.541731:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1785220000.541736:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785220000.541782:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078dcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541797:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541805:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541811:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541818:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220000.541822:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541838:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541853:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:0.0:1785220000.541857:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220000.541863:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541869:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541889:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541896:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541902:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541908:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220000.541910:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541917:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541924:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf34a441700) 00010000:00010000:0.0:1785220000.541926:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220000.541929:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541945:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dcaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.541992:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7ec expref: 12 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.542008:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1a00/0x8b38d407a078dcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7ec expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.542016:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:0.0:1785220000.542018:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1785220000.542021:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b1a00, rc 0) 00000100:00100000:0.0:1785220000.542623:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+11:14426:x1871938444184320:12345-192.168.203.31@tcp:101:bash.0 Request processed in 1746us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220000.542634:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 27 00000100:00100000:1.0:1785220000.546655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.546771:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444184576 00000100:00100000:3.0:1785220000.546782:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444184576 00000100:00100000:3.0:1785220000.546847:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 28 00000100:00100000:3.0:1785220000.546857:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+11:14426:x1871938444184576:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:3.0:1785220000.546880:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220000.546905:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dcbd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7f3 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.547704:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.547725:0:16345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 11 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.547733:0:16345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.547772:0:16345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 11 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.547788:0:16345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 11 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220000.547820:0:16345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1871938465144192:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785220000.547936:0:16345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf350320900 going to sleep for 11 seconds 00000100:00100000:1.0:1785220000.552829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220000.552925:0:16234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444184704 00000100:00100000:0.0:1785220000.552936:0:16234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444184704 00010000:00010000:0.0:1785220000.552986:0:16234:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 12 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220000.553034:0:16234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:0.0:1785220000.553044:0:16234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+12:2361:x1871938444184704:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785220000.553321:0:16234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785220000.553330:0:16234:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 12 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.553401:0:16234:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 12 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.553427:0:16234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:0.0:1785220000.553432:0:16234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.553442:0:16234:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.553449:0:16234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.553469:0:16234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785220000.553529:0:16234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+12:2361:x1871938444184704:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 486us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220000.553538:0:16234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00010000:00010000:3.0:1785220000.553744:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078dc9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7e5 expref: 11 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220000.553762:0:16345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16345:1871938465144192:192.168.203.31@tcp:104: 00010000:00010000:3.0:1785220000.553784:0:16345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.553792:0:16345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.553797:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.553822:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.553830:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.553838:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555802:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555822:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555845:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785220000.555858:0:16345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1785220000.555890:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555897:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555904:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555910:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785220000.555914:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555921:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555932:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785220000.555935:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785220000.555939:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.555945:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dcc4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785220000.555959:0:16345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041bef468 reply state 00000000d4c6d8d4 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220000.555978:0:16345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785220000.556020:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078dcbd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 14 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.556034:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 13 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220000.556041:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:3.0:1785220000.556043:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1785220000.556045:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031200, rc 0) 00000100:00100000:3.0:1785220000.556599:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:14426:x1871938444184576:12345-192.168.203.31@tcp:101:bash.0 Request processed in 9740us (9950us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1785220000.556609:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 28 00010000:00010000:0.0:1785220000.560953:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.560972:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.560980:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.560986:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220000.560991:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.561017:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.561034:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cf356788700) 00010000:00010000:0.0:1785220000.561037:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220000.561041:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220000.561047:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078dccb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220000.574666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.574909:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444184832 00000100:00100000:2.0:1785220000.574920:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444184832 00000100:00100000:2.0:1785220000.574983:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:2.0:1785220000.574993:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+13:14426:x1871938444184832:12345-192.168.203.31@tcp:101:bash.0 00010000:00010000:2.0:1785220000.575018:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220000.575040:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dce0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f7fa expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.575134:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.575160:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.575186:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785220000.575544:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785220000.575551:0:14220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785220000.575576:0:14220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.575588:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.575614:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dce0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.575634:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 14 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.575643:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:2.0:1785220000.575645:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785220000.575648:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9e00, rc 0) 00000100:00100000:2.0:1785220000.575705:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:14426:x1871938444184832:12345-192.168.203.31@tcp:101:bash.0 Request processed in 714us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220000.575713:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:1.0:1785220000.580022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.580197:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444185088 00000100:00100000:3.0:1785220000.580217:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444185088 00000100:00100000:3.0:1785220000.580279:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:3.0:1785220000.580290:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:14426:x1871938444185088:12345-192.168.203.31@tcp:35:bash.0 00000100:00100000:3.0:1785220000.580699:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+15:14426:x1871938444185088:12345-192.168.203.31@tcp:35:bash.0 Request processed in 410us (686us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1785220000.580707:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00010000:00010000:1.0:1785220000.619639:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785220000.677325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.677648:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444185344 00000100:00100000:2.0:1785220000.677659:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444185344 00000100:00100000:2.0:1785220000.677724:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:2.0:1785220000.677734:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+15:14436:x1871938444185344:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785220000.677760:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220000.677796:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dcee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f801 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785220000.677925:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785220000.678043:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dcee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f801 expref: 17 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.678071:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf356788c00) 00010000:00010000:2.0:1785220000.678074:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785220000.678079:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dcee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f801 expref: 17 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.678096:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc9000, rc 0) 00000100:00100000:2.0:1785220000.678164:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+16:14436:x1871938444185344:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 432us (849us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1785220000.678172:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:1.0:1785220000.683874:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.683949:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444185600 00000100:00100000:3.0:1785220000.683960:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444185600 00000100:00100000:3.0:1785220000.684017:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:3.0:1785220000.684027:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+16:14436:x1871938444185600:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1785220000.684742:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+17:14436:x1871938444185600:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 711us (873us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1785220000.684763:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:1.0:1785220000.735602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.735753:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444185856 00000100:00100000:2.0:1785220000.735762:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444185856 00000100:00100000:2.0:1785220000.735818:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:2.0:1785220000.735828:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+17:14439:x1871938444185856:12345-192.168.203.31@tcp:101:lfs.0 00010000:00010000:2.0:1785220000.735852:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220000.735872:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dcfc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f808 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.735974:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.735988:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.736013:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785220000.736026:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1785220000.736182:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9000/0x8b38d407a078dcfc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f808 expref: 20 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.736330:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f808 expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.736342:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:2.0:1785220000.736345:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785220000.736349:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8000, rc 0) 00000100:00100000:2.0:1785220000.736836:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:14439:x1871938444185856:12345-192.168.203.31@tcp:101:lfs.0 Request processed in 1005us (1239us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1785220000.736845:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 31 00000100:00100000:1.0:1785220000.744478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220000.744538:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444185984 00000100:00100000:2.0:1785220000.744548:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444185984 00000100:00100000:2.0:1785220000.744604:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:2.0:1785220000.744614:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:14439:x1871938444185984:12345-192.168.203.31@tcp:54:lfs.0 00010000:00010000:2.0:1785220000.744685:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744702:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744713:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744757:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744764:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744771:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744777:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8a00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220000.744781:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744788:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744799:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:2.0:1785220000.744801:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785220000.744805:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220000.744811:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220000.744880:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:14439:x1871938444185984:12345-192.168.203.31@tcp:54:lfs.0 Request processed in 267us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220000.744887:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 32 00000100:00100000:3.0:1785220000.747745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785220000.747897:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444186112 00000100:00100000:1.0:1785220000.747907:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444186112 00000100:00100000:1.0:1785220000.747974:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1785220000.747984:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:2362:x1871938444186112:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785220000.748011:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785220000.748038:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f808 expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220000.748069:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:1.0:1785220000.748074:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785220000.748136:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:2362:x1871938444186112:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 153us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1785220000.748151:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1785220000.751027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220000.751124:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444186368 00000100:00100000:3.0:1785220000.751134:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444186368 00000100:00100000:3.0:1785220000.751199:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:3.0:1785220000.751209:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:14439:x1871938444186368:12345-192.168.203.31@tcp:35:lfs.0 00000100:00100000:3.0:1785220000.751483:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:14439:x1871938444186368:12345-192.168.203.31@tcp:35:lfs.0 Request processed in 274us (463us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1785220000.751490:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:2.0:1785220001.004714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220001.007917:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444186624 00000100:00100000:0.0:1785220001.007932:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444186624 00000100:00100000:0.0:1785220001.008031:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:0.0:1785220001.008044:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:14470:x1871938444186624:12345-192.168.203.31@tcp:101:cat.0 00010000:00010000:0.0:1785220001.008081:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1785220001.008096:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785220001.008101:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f80f expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.008202:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.008216:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.008228:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785220001.008240:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1785220001.008729:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd18 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f80f expref: 22 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.008754:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f80f expref: 21 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.008764:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785220001.008766:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785220001.008769:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0600, rc 0) 00000100:00100000:0.0:1785220001.008881:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+21:14470:x1871938444186624:12345-192.168.203.31@tcp:101:cat.0 Request processed in 841us (4176us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1785220001.008889:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 33 00000100:00100000:1.0:1785220001.012896:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220001.012985:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444186880 00000100:00100000:3.0:1785220001.012995:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444186880 00000100:00100000:3.0:1785220001.013064:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:3.0:1785220001.013074:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+21:14470:x1871938444186880:12345-192.168.203.31@tcp:35:cat.0 00000100:00100000:3.0:1785220001.015923:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+22:14470:x1871938444186880:12345-192.168.203.31@tcp:35:cat.0 Request processed in 2840us (3025us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1785220001.015938:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 8 00000100:00100000:2.0:1785220001.016084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220001.016415:0:16234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444187008 00000100:00100000:0.0:1785220001.016424:0:16234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444187008 00000100:00100000:0.0:1785220001.016474:0:16234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:0.0:1785220001.016482:0:16234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf38114dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+22:2362:x1871938444187008:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785220001.016497:0:16234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785220001.016522:0:16234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f80f expref: 22 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.016555:0:16234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785220001.016560:0:16234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785220001.016614:0:16234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf38114dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+21:2362:x1871938444187008:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 133us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220001.016621:0:16234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1785220001.110495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220001.110616:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444187264 00000100:00100000:2.0:1785220001.110627:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444187264 00000100:00100000:2.0:1785220001.110688:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:2.0:1785220001.110698:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+21:14476:x1871938444187264:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:2.0:1785220001.110723:0:14219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220001.110745:0:14219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd2d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f816 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.110845:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.110861:0:14219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 22 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.110869:0:14219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 22 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.110877:0:14219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.110910:0:14219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 22 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.110924:0:14219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 22 pid: 14220 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220001.110937:0:14219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf38114e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14219:1871938465144320:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785220001.111456:0:14219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 22 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.111480:0:14219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 22 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220001.111491:0:14219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14219:1871938465144448:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785220001.111519:0:14219:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf34a4e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785220001.117207:0:14219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf38114e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14219:1871938465144320:192.168.203.31@tcp:104: 00000100:00100000:2.0:1785220001.117234:0:14219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14219:1871938465144448:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785220001.117740:0:14219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220001.125471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785220001.125519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220001.125579:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444187392 00000100:00100000:2.0:1785220001.125589:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444187392 00010000:00010000:2.0:1785220001.125629:0:14205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 23 pid: 14220 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220001.125708:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444187520 00000100:00100000:2.0:1785220001.125713:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444187520 00010000:00010000:2.0:1785220001.125727:0:14205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 24 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220001.125869:0:16234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1785220001.125882:0:16234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:2361:x1871938444187392:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785220001.125915:0:16234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785220001.125922:0:16234:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 24 pid: 14220 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.125935:0:16234:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 24 pid: 14220 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.125958:0:16234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078dce7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7fa expref: 24 pid: 14220 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.125976:0:16234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785220001.125981:0:16234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.125990:0:16234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.125997:0:16234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785220001.126064:0:16234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+23:2361:x1871938444187392:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 175us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220001.126072:0:16234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1785220001.126127:0:16234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:0.0:1785220001.126134:0:16234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+22:2361:x1871938444187520:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785220001.126142:0:16234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785220001.126147:0:16234:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 22 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126168:0:16234:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 22 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126180:0:16234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dcd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f7f3 expref: 22 pid: 16345 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126191:0:16234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785220001.126194:0:16234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126201:0:16234:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126208:0:16234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126244:0:16234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785220001.126351:0:16234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+21:2361:x1871938444187520:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 215us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220001.126357:0:16234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00010000:00010000:0.0:1785220001.126425:0:14219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126432:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785220001.126450:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1785220001.126609:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8a00/0x8b38d407a078dd2d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f816 expref: 22 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126637:0:14219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8000/0x8b38d407a078dd34 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f816 expref: 21 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.126645:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785220001.126648:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1785220001.126651:0:14219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8000, rc 0) 00000100:00100000:0.0:1785220001.126678:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+21:14476:x1871938444187264:12345-192.168.203.31@tcp:101:dd.0 Request processed in 15983us (16205us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1785220001.126685:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 34 00000100:00100000:1.0:1785220001.134914:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000040:00080000:0.0:1785220001.136706:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1785220001.136757:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444187776 00000100:00100000:3.0:1785220001.136768:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444187776 00000100:00100000:3.0:1785220001.136832:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 35 00000100:00100000:3.0:1785220001.136843:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+21:14476:x1871938444187776:12345-192.168.203.31@tcp:36:dd.0 00010000:00010000:3.0:1785220001.137156:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.137174:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.137212:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785220001.137270:0:14220:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1785220001.137298:0:14220:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a91458f reply state 00000000a2c408c3 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220001.138179:0:14220:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785220001.139900:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14476:x1871938444187776:12345-192.168.203.31@tcp:36:dd.0 Request processed in 3050us (4987us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1785220001.139912:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 35 00000020:00080000:3.0:1785220001.139919:0:14220:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785220001.141668:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.141684:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.141692:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.141714:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220001.141720:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.141727:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.141745:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:2.0:1785220001.141748:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220001.141753:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220001.141758:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220001.145428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220001.145671:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444187904 00000100:00100000:3.0:1785220001.145681:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444187904 00000100:00100000:3.0:1785220001.145738:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:3.0:1785220001.145748:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+23:14476:x1871938444187904:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1785220001.145773:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220001.145794:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f81d expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.145855:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f81d expref: 24 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.145870:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f81d expref: 24 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.145889:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:3.0:1785220001.145904:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785220001.145908:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030a00, rc 0) 00000100:00100000:3.0:1785220001.145970:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14476:x1871938444187904:12345-192.168.203.31@tcp:101:dd.0 Request processed in 223us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220001.145976:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 36 00000100:00100000:1.0:1785220001.174711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220001.177431:0:16234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444188160 00000100:00100000:0.0:1785220001.177444:0:16234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444188160 00000100:00100000:0.0:1785220001.177521:0:16234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:0.0:1785220001.177531:0:16234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14476:x1871938444188160:12345-192.168.203.31@tcp:103:dd.0 00010000:00010000:0.0:1785220001.177547:0:16234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785220001.177574:0:16234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f81d expref: 24 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.177595:0:16234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785220001.177599:0:16234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785220001.177654:0:16234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+23:14476:x1871938444188160:12345-192.168.203.31@tcp:103:dd.0 Request processed in 125us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220001.177662:0:16234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785220001.180601:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220001.180769:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444188288 00000100:00100000:0.0:1785220001.180780:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444188288 00000100:00100000:0.0:1785220001.180864:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:0.0:1785220001.180875:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+23:14476:x1871938444188288:12345-192.168.203.31@tcp:58:dd.0 00010000:00010000:0.0:1785220001.180986:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.181005:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220001.181018:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785220001.182153:0:14221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785220001.182944:0:14221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1785220001.183031:0:14221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1785220001.183223:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+23:14476:x1871938444188288:12345-192.168.203.31@tcp:58:dd.0 Request processed in 2338us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220001.183234:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 37 00000100:00100000:1.0:1785220001.190818:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220001.190927:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444188416 00000100:00100000:3.0:1785220001.190938:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444188416 00000100:00100000:3.0:1785220001.191043:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 38 00000100:00100000:3.0:1785220001.191065:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+23:14476:x1871938444188416:12345-192.168.203.31@tcp:101:dd.0 00010000:00010000:3.0:1785220001.191088:0:16345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220001.191108:0:16345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f824 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.191178:0:16345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.191190:0:16345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f824 expref: 24 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.191323:0:16345:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.191340:0:16345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f824 expref: 24 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.191354:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:3.0:1785220001.191358:0:16345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785220001.191412:0:16345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f824 expref: 24 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220001.191444:0:16345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340031a00, rc 0) 00000100:00100000:3.0:1785220001.191497:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14476:x1871938444188416:12345-192.168.203.31@tcp:101:dd.0 Request processed in 444us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220001.191504:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 38 00010000:00010000:3.0:1785220001.643531:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785220002.155609:0:14254:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1785220002.155619:0:14254:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785220002.155679:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1785220002.155687:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1785220002.155818:0:14254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14254:1871938465144576:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785220002.155917:0:14254:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351f170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785220002.177611:0:14254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf349c61c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14254:1871938465144576:192.168.203.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785220002.180620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.180856:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444188544 00000100:00100000:0.0:1785220002.180868:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444188544 00000100:00100000:0.0:1785220002.180912:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1785220002.180922:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14477:x1871938444188544:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1785220002.181029:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14477:x1871938444188544:12345-192.168.203.31@tcp:900:lhsmtool_posix.0 Request processed in 108us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.181037:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1785220002.210784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.210871:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444188672 00000100:00100000:3.0:1785220002.210880:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444188672 00000100:00100000:3.0:1785220002.210943:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:3.0:1785220002.210954:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14477:x1871938444188672:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785220002.210986:0:14220:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785220002.211103:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14477:x1871938444188672:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 151us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220002.211111:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 39 00000100:00100000:2.0:1785220002.219467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.219593:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444188800 00000100:00100000:0.0:1785220002.219604:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444188800 00000100:00100000:0.0:1785220002.219663:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1785220002.219674:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14477:x1871938444188800:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1785220002.219747:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219763:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219776:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219823:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219832:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219838:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219859:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219866:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219887:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785220002.219926:0:14219:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1785220002.219930:0:14219:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785220002.219946:0:14219:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219957:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219964:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219971:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219977:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0800 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220002.219982:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.219989:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220000:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788d00) 00010000:00010000:0.0:1785220002.220002:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220002.220006:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220013:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0800/0x8b38d407a078dd5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220056:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220063:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220070:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220076:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220002.220079:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220086:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220094:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9cf34a441700) 00010000:00010000:0.0:1785220002.220096:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220002.220099:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220104:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1c00/0x8b38d407a078dd65 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220119:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220126:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220132:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220143:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:0.0:1785220002.220147:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220153:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220161:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:0.0:1785220002.220163:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785220002.220166:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.220172:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0400/0x8b38d407a078dd6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220002.220242:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14477:x1871938444188800:12345-192.168.203.31@tcp:34:lhsmtool_posix.0 Request processed in 569us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.220249:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 40 00000100:00100000:0.0:1785220002.231078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.233926:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444189056 00000100:00100000:3.0:1785220002.233943:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444189056 00000100:00100000:3.0:1785220002.236821:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:3.0:1785220002.236845:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+24:14477:x1871938444189056:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785220002.236869:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220002.236894:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078dd73 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f82b expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.236997:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.237013:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.237039:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785220002.237061:0:14220:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1785220002.237230:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.237239:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.237246:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.238737:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340030200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785220002.238747:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.238759:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.238774:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:3.0:1785220002.238777:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785220002.238782:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.238789:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030200/0x8b38d407a078dd7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.245813:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078dd73 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f82b expref: 26 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.245837:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf356788d00) 00010000:00010000:2.0:1785220002.245841:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785220002.245847:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078dd73 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f82b expref: 26 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.245864:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030c00, rc 0) 00000100:00100000:2.0:1785220002.245946:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+25:14477:x1871938444189056:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 9112us (14875us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1785220002.245956:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 41 00000100:00100000:1.0:1785220002.264271:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.264981:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444189184 00000100:00100000:0.0:1785220002.264992:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444189184 00000100:00100000:0.0:1785220002.265066:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:0.0:1785220002.265077:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+25:14477:x1871938444189184:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785220002.265128:0:14219:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785220002.265249:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+25:14477:x1871938444189184:12345-192.168.203.31@tcp:53:lhsmtool_posix.0 Request processed in 173us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.265257:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 42 00000100:00100000:1.0:1785220002.269439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.269673:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444189440 00000100:00100000:3.0:1785220002.269683:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444189440 00000100:00100000:3.0:1785220002.269742:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:3.0:1785220002.269768:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+25:14477:x1871938444189440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785220002.269788:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220002.269814:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078dd88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f832 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785220002.270641:0:14221:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1785220002.270649:0:14221:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1785220002.270690:0:14221:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1785220002.270936:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.270952:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.270963:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.271016:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030400/0x8b38d407a078dd88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f832 expref: 28 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.271035:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f832 expref: 27 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.271053:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785220002.271056:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785220002.271059:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030a00, rc 0) 00000100:00100000:3.0:1785220002.271117:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+27:14477:x1871938444189440:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 1355us (1684us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1785220002.271125:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 43 00000100:00100000:2.0:1785220002.285121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.285285:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444189696 00000100:00100000:3.0:1785220002.285295:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444189696 00000100:00100000:3.0:1785220002.285353:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:3.0:1785220002.285400:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+27:14477:x1871938444189696:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785220002.285456:0:14219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785220002.285486:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030a00/0x8b38d407a078dd8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f832 expref: 27 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285503:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788800) 00010000:00010000:3.0:1785220002.285513:0:14219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785220002.285536:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285550:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285560:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285619:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285627:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285634:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285856:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285876:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285884:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285890:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031400 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785220002.285894:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285900:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285909:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf356788900) 00010000:00010000:3.0:1785220002.285912:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785220002.285916:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285921:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031400/0x8b38d407a078dd9d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285931:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285936:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285942:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285946:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf340031200 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785220002.285955:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285960:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285967:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa87a0a2a (ffff9cf356788100) 00010000:00010000:3.0:1785220002.285969:0:14219:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785220002.285972:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.285978:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031200/0x8b38d407a078dda4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa87a0a2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220002.286268:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+26:14477:x1871938444189696:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 904us (1156us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785220002.286277:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 44 00000100:00100000:2.0:1785220002.288634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.288783:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444189824 00000100:00100000:3.0:1785220002.288794:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444189824 00000100:00100000:3.0:1785220002.288856:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:3.0:1785220002.288866:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+26:14477:x1871938444189824:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785220002.288888:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785220002.288909:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078ddab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f839 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.288946:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078ddb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.288960:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078ddb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.288990:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078ddb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.289290:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030800/0x8b38d407a078ddab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f839 expref: 28 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.289311:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340030c00/0x8b38d407a078ddb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f839 expref: 27 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.289320:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:3.0:1785220002.289323:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785220002.289326:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf340030c00, rc 0) 00000100:00100000:3.0:1785220002.289419:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+27:14477:x1871938444189824:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 554us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220002.289425:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 45 00000100:00100000:0.0:1785220002.292090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.292183:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444190080 00000100:00100000:3.0:1785220002.292194:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444190080 00000100:00100000:3.0:1785220002.292251:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:3.0:1785220002.292260:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+27:14477:x1871938444190080:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785220002.292345:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.292361:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.292412:0:14219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785220002.292922:0:14219:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1785220002.292933:0:14219:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 495145568595ns, next at 496145566331ns, rc = 0 00000004:00010000:3.0:1785220002.293024:0:14219:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecd74369 reply state 00000000916bedc9 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220002.293034:0:14219:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785220002.293144:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+29:14477:x1871938444190080:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 882us (1059us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1785220002.293151:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 46 00000100:00100000:0.0:1785220002.300227:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220002.300753:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444190208 00000100:00100000:2.0:1785220002.300764:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444190208 00000100:00100000:2.0:1785220002.300823:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 47 00000100:00100000:2.0:1785220002.300832:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+29:14477:x1871938444190208:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785220002.300856:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220002.300876:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f840 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.300931:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 30 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.300944:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 30 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.300962:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:2.0:1785220002.300965:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785220002.300969:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8800, rc 0) 00000100:00100000:2.0:1785220002.301017:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+30:14477:x1871938444190208:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 187us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220002.301023:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 47 00010000:00010000:3.0:1785220002.301170:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.301178:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.301186:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.301192:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:3.0:1785220002.301196:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.301204:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.301215:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:3.0:1785220002.301218:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785220002.301222:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.301244:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddb9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14219 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220002.305461:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785220002.305594:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444190336 00000100:00100000:1.0:1785220002.305605:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444190336 00000100:00100000:1.0:1785220002.305660:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00100000:1.0:1785220002.305670:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2362:x1871938444190336:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1785220002.306010:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2362:x1871938444190336:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 341us (559us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1785220002.306018:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 12 00000100:00080000:2.0:1785220002.306084:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1785220002.307634:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:0.0:1785220002.307649:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1785220002.307665:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:0.0:1785220002.307677:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1785220002.309245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220002.309568:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444190592 00000100:00100000:2.0:1785220002.309578:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444190592 00000100:00100000:2.0:1785220002.309633:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:2.0:1785220002.309643:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf349c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+16:14477:x1871938444190592:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785220002.309902:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf349c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+17:14477:x1871938444190592:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 260us (663us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1785220002.309909:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 9 00000100:00100000:3.0:1785220002.311979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.312166:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444190848 00000100:00100000:0.0:1785220002.312174:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444190848 00000100:00100000:0.0:1785220002.312239:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1785220002.312248:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+17:14477:x1871938444190848:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785220002.312455:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+17:14477:x1871938444190848:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 207us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.312462:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 48 00000100:00100000:0.0:1785220002.319477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220002.319615:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444190976 00000100:00100000:2.0:1785220002.319625:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444190976 00000100:00100000:2.0:1785220002.319686:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1785220002.319695:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+17:14477:x1871938444190976:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785220002.319715:0:14220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785220002.319735:0:14220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078ddc7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f847 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.319818:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078ddce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.319831:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078ddce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.319842:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078ddce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785220002.319880:0:14220:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785220002.319898:0:14220:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078ddce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14220 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.319922:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8e00/0x8b38d407a078ddc7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f847 expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.319939:0:14220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078ddce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f847 expref: 18 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.319959:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:2.0:1785220002.319962:0:14220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785220002.319966:0:14220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf37edc8c00, rc 0) 00000100:00100000:2.0:1785220002.320027:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:14477:x1871938444190976:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 332us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220002.320033:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 49 00000100:00100000:2.0:1785220002.323037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.323141:0:16347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444191104 00000100:00100000:0.0:1785220002.323151:0:16347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444191104 00000100:00100000:0.0:1785220002.323212:0:16347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1785220002.323222:0:16347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+6:2360:x1871938444191104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785220002.323242:0:16347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785220002.323266:0:16347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9e15b6d94b82f84e expref: -99 pid: 16347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785220002.323295:0:16347:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a684ba1, blocks: 0x1 00010000:00010000:0.0:1785220002.323317:0:16347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1785220002.323321:0:16347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785220002.323331:0:16347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 7 pid: 16347 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.323537:0:16347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 7 pid: 16347 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.323553:0:16347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf3489b0a00, rc 0) 00000100:00100000:0.0:1785220002.323700:0:16347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:2360:x1871938444191104:12345-192.168.203.31@tcp:101:lhsmtool_posix.0 Request processed in 478us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.323707:0:16347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1785220002.328193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.328294:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444191360 00000100:00100000:3.0:1785220002.328304:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444191360 00000100:00100000:3.0:1785220002.328410:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:3.0:1785220002.328420:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:14477:x1871938444191360:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1785220002.328567:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:14477:x1871938444191360:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 148us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220002.328574:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 50 00000100:00100000:2.0:1785220002.331122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.331241:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444191488 00000100:00100000:0.0:1785220002.331252:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444191488 00000100:00100000:0.0:1785220002.331343:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1785220002.331353:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:14477:x1871938444191488:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1785220002.380155:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1785220002.380176:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1785220002.380430:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785220002.380449:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465144704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1785220002.380520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785220002.380589:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465144704 00000100:00100000:3.0:1785220002.380596:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465144704 00000100:00100000:3.0:1785220002.380651:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785220002.380660:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1871938465144704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1785220002.380985:0:14855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785220002.380989:0:14855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1785220002.380991:0:14855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785220002.380994:0:14855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1785220001 -> 1785220001 00002000:00010000:3.0:1785220002.380996:0:14855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1785220002.381040:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1871938465144704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 380us (519us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1785220002.381060:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1785220002.381102:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1785220002.381152:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf381a28700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1785220002.381159:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1871938465144704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1785220002.381408:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:14477:x1871938444191488:12345-192.168.203.31@tcp:44:lhsmtool_posix.0 Request processed in 50053us (50292us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.381417:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 51 00000100:00100000:0.0:1785220002.384468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785220002.384553:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444191616 00000100:00100000:1.0:1785220002.384564:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444191616 00000100:00100000:1.0:1785220002.384624:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:1.0:1785220002.384634:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:2362:x1871938444191616:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1785220002.384752:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:2362:x1871938444191616:12345-192.168.203.31@tcp:16:lhsmtool_posix.0 Request processed in 120us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1785220002.384760:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 15 00000100:00100000:3.0:1785220002.388217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.388444:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444191872 00000100:00100000:0.0:1785220002.388456:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444191872 00000100:00100000:0.0:1785220002.388521:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:0.0:1785220002.388531:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:14477:x1871938444191872:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785220002.388595:0:16345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785220002.388626:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8c00/0x8b38d407a078ddce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f847 expref: 14 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.388664:0:16345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:0.0:1785220002.388670:0:16345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785220002.388705:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.388718:0:16345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.388738:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785220002.388945:0:16345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000478ead4b reply state 000000001cf84057 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220002.388955:0:16345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785220002.391596:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+15:14477:x1871938444191872:12345-192.168.203.31@tcp:36:lhsmtool_posix.0 Request processed in 545us (867us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1785220002.391615:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 52 00000100:00100000:3.0:1785220002.393176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.393341:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444192000 00000100:00100000:0.0:1785220002.393351:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444192000 00000100:00100000:0.0:1785220002.393441:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1785220002.393451:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+7:2361:x1871938444192000:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1785220002.393649:0:14855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1785220002.393653:0:14855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1785220000 00002000:00010000:0.0:1785220002.393656:0:14855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1785220000 00002000:00010000:0.0:1785220002.393658:0:14855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1785220001 -> 1785220000 00002000:00010000:0.0:1785220002.393660:0:14855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1785220002.393723:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+8:2361:x1871938444192000:12345-192.168.203.31@tcp:2:lhsmtool_posix.0 Request processed in 274us (553us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1785220002.393730:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:3.0:1785220002.396709:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.396787:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444192128 00000100:00100000:0.0:1785220002.396796:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444192128 00000100:00100000:0.0:1785220002.396854:0:14853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1785220002.396864:0:14853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf381a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+8:2359:x1871938444192128:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1785220002.396910:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.396927:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785220002.396932:0:14853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785220002.396937:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.396951:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.396980:0:14853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.396989:0:14853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.396996:0:14853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.397021:0:14853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:0.0:1785220002.397025:0:14853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.397033:0:14853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.397057:0:14853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.397064:0:14853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9d490f/0x8b38d407a078dde3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220002.397155:0:14853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf381a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+8:2359:x1871938444192128:12345-192.168.203.31@tcp:1:lhsmtool_posix.0 Request processed in 292us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.397163:0:14853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00010000:00010000:1.0:1785220002.398350:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.398386:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.398394:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.398400:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:1.0:1785220002.398405:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.398412:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.398426:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:1.0:1785220002.398440:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785220002.398445:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.398452:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0e00/0x8b38d407a078dddc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.400269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.400347:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444192384 00000100:00100000:3.0:1785220002.400357:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444192384 00000100:00100000:3.0:1785220002.400443:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 53 00000100:00100000:3.0:1785220002.400453:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:14477:x1871938444192384:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1785220002.400534:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.400551:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.400562:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.400809:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.400822:0:14221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.400830:0:14221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.400866:0:14221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.400892:0:14221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 15 pid: 14220 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220002.400906:0:14221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1871938465144832:192.168.203.31@tcp:104: 00000100:00100000:3.0:1785220002.400989:0:14221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785220002.404099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.404396:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444192512 00000100:00100000:0.0:1785220002.404406:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444192512 00010000:00010000:0.0:1785220002.404442:0:14205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 16 pid: 14220 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220002.404473:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 13 00000100:00100000:0.0:1785220002.404480:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+16:2361:x1871938444192512:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785220002.404495:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785220002.404514:0:14205:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 16 pid: 14220 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.404527:0:14205:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 16 pid: 14220 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.404548:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:0.0:1785220002.404553:0:14205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.404563:0:14205:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.404572:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.404589:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785220002.404632:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf247279f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+16:2361:x1871938444192512:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 153us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.404639:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 13 00010000:00010000:2.0:1785220002.405024:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc8800/0x8b38d407a078ddc0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f840 expref: 15 pid: 14220 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.405040:0:14221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf381a28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1871938465144832:192.168.203.31@tcp:104: 00010000:00010000:2.0:1785220002.405072:0:14221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.405086:0:14221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.405093:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785220002.405849:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1785220002.405969:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1785220002.406007:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1785220002.406768:0:14221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1871938465144960:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785220002.406876:0:14221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785220002.406911:0:14221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785220002.406986:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465144960 00000100:00100000:2.0:1785220002.406993:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465144960 00000100:00100000:2.0:1785220002.407284:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785220002.407294:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14221:x1871938465144960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785220002.407404:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14221:x1871938465144960:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220002.407411:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785220002.407485:0:14221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1871938465144960:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1785220002.408525:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1785220002.408610:0:14221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1871938465145088:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785220002.408655:0:14221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785220002.408998:0:14221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf37e997f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785220002.409034:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465145088 00000100:00100000:1.0:1785220002.409041:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465145088 00000100:00100000:1.0:1785220002.409238:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785220002.409246:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14221:x1871938465145088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785220002.409807:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14221:x1871938465145088:12345-0@lo:1000:mdt00_002.0 Request processed in 560us (1150us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1785220002.409822:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785220002.409910:0:14221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf3506c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14221:1871938465145088:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1785220002.409947:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.409959:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.409969:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.409976:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06c00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220002.409981:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.409990:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410007:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:2.0:1785220002.410010:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785220002.410015:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410022:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06c00/0x8b38d407a078ddf1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410245:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410265:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410271:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410276:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0600 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220002.410279:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410285:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410295:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:2.0:1785220002.410298:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785220002.410304:0:14221:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f824 expref: 18 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410314:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f824 expref: 18 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410323:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f824 expref: 18 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.410569:0:14221:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf340031a00/0x8b38d407a078dd57 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f824 expref: 18 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.410582:0:14221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1871938465145216:192.168.203.31@tcp:105: 00000100:00100000:2.0:1785220002.410712:0:14221:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf3494a5900 going to sleep for 11 seconds 00000100:00100000:3.0:1785220002.416893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785220002.416969:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444192640 00000100:00100000:1.0:1785220002.416979:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444192640 00000100:00100000:1.0:1785220002.417034:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:1.0:1785220002.417055:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf351907c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:14476:x1871938444192640:12345-192.168.203.31@tcp:49:dd.0 00000100:00100000:2.0:1785220002.417781:0:14221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14221:1871938465145216:192.168.203.31@tcp:105: 00010000:00010000:2.0:1785220002.417807:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417817:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b0600/0x8b38d407a078dd50 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417853:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417867:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417877:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417886:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417891:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417897:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417902:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc9e00 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220002.417905:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417912:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417940:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:2.0:1785220002.417943:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785220002.417946:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417951:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf37edc9e00/0x8b38d407a078ddf8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417962:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417968:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417973:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417978:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf344f06000 already unused, calling callback (ffffffffc1fcb4f0) 00010000:00010000:2.0:1785220002.417981:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417986:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.417993:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf356788b00) 00010000:00010000:2.0:1785220002.417996:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785220002.417999:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.418004:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf344f06000/0x8b38d407a078ddea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785220002.418313:0:14254:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1785220002.418318:0:14254:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785220002.418359:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1785220002.418393:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1785220002.418867:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf351907c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:14476:x1871938444192640:12345-192.168.203.31@tcp:49:dd.0 Request processed in 1821us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1785220002.418877:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 10 00000100:00100000:2.0:1785220002.418979:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:14477:x1871938444192384:12345-192.168.203.31@tcp:57:lhsmtool_posix.0 Request processed in 18526us (18716us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1785220002.418988:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 53 00000020:00080000:2.0:1785220002.418992:0:14221:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1785220002.431751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785220002.435624:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444192896 00000100:00100000:1.0:1785220002.435640:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444192896 00000100:00100000:0.0:1785220002.439386:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 11 00000100:00100000:0.0:1785220002.439402:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:14477:x1871938444192896:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1785220002.441359:0:14223:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1785220002.441610:0:14223:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1785220002.441680:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.441697:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.441708:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.441718:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.441724:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.441731:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.441759:0:14223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785220002.443243:0:14208:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785220002.443255:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.443265:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b1e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785220002.443270:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.443279:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.443322:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf356788600) 00010000:00010000:1.0:1785220002.443325:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785220002.443330:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.443336:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf3489b1e00/0x8b38d407a078ddff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.443355:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785220002.443357:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785220002.443359:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785220002.443595:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+20:14477:x1871938444192896:12345-192.168.203.31@tcp:35:lhsmtool_posix.0 Request processed in 4190us (11848us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1785220002.443606:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 11 00000020:00080000:0.0:1785220002.443613:0:14223:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785220002.576005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.576060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.576097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.576233:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.585635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220002.586473:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193024 00000100:00100000:0.0:1785220002.586486:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193024 00000100:00100000:0.0:1785220002.586557:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193152 00000100:00100000:0.0:1785220002.586561:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193152 00000100:00100000:0.0:1785220002.586577:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193280 00000100:00100000:0.0:1785220002.586580:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193280 00000100:00100000:0.0:1785220002.586593:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193408 00000100:00100000:0.0:1785220002.586596:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193408 00000100:00100000:0.0:1785220002.586617:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:0.0:1785220002.586627:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+11:2362:x1871938444193024:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:0.0:1785220002.586680:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.586701:0:14861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 11 pid: 16347 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.586710:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785220002.586714:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785220002.586719:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.586756:0:14861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 11 pid: 16347 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785220002.586770:0:14861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 11 pid: 16347 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220002.586785:0:14861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:14861:1871938465145344:192.168.203.31@tcp:104: 00000100:00100000:0.0:1785220002.586874:0:14861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cf351f17480 going to sleep for 11 seconds 00000100:00100000:3.0:1785220002.589180:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.589738:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:1.0:1785220002.589860:0:14859:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1785220002.589902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:2.0:1785220002.589919:0:14860:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1785220002.589938:0:14859:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1785220002.590353:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193536 00000100:00100000:0.0:1785220002.590384:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193536 00000100:00100000:0.0:1785220002.590432:0:14859:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1785220002.590439:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193664 00000100:00100000:0.0:1785220002.590442:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193664 00000100:00100000:0.0:1785220002.590457:0:14859:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1785220002.590462:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193792 00000100:00100000:0.0:1785220002.590464:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193792 00000100:00100000:1.0:1785220002.591033:0:16350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:1.0:1785220002.591057:0:16350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:2362:x1871938444193152:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:1.0:1785220002.591108:0:16350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.591140:0:16350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.591145:0:16350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.591151:0:16350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.591161:0:16350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220002.591711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:3.0:1785220002.591743:0:16234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194048 00000100:00100000:3.0:1785220002.591754:0:16234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194048 00010000:00010000:3.0:1785220002.591776:0:16234:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 15 pid: 16347 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785220002.591802:0:16234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:3.0:1785220002.591808:0:16234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+15:2361:x1871938444194048:12345-192.168.203.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785220002.591819:0:16234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785220002.591841:0:16234:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 15 pid: 16347 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.591853:0:16234:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 15 pid: 16347 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.591876:0:16234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785220002.591879:0:16234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785220002.591884:0:16234:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.591894:0:16234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.591902:0:16234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785220002.591904:0:16234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785220002.591908:0:16234:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.591915:0:16234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785220002.591943:0:16234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785220002.591992:0:16234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+15:2361:x1871938444194048:12345-192.168.203.31@tcp:103:ldlm_bl.0 Request processed in 183us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220002.591999:0:16234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 14 00000100:00100000:2.0:1785220002.592703:0:14860:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1785220002.593735:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444193920 00000100:00100000:3.0:1785220002.593748:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444193920 00010000:00010000:1.0:1785220002.593913:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077fd6759/0x8b38d407a078ddd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.31@tcp remote: 0x9e15b6d94b82f84e expref: 15 pid: 16347 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220002.593950:0:14861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:14861:1871938465145344:192.168.203.31@tcp:104: 00010000:00010000:1.0:1785220002.593977:0:14861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.593988:0:14861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.593995:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.594674:0:16351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:2.0:1785220002.594686:0:16351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:2362:x1871938444193280:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:2.0:1785220002.594720:0:16351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.594733:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785220002.594737:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785220002.594744:0:16351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.594757:0:16351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.597845:0:16350:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.597865:0:16350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.667554:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785220002.677628:0:16351:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1785220002.677637:0:16351:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1785220000 -> 1785220002 00002000:00010000:1.0:1785220002.677640:0:16351:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1785220000 -> 1785220002 00002000:00010000:1.0:1785220002.677643:0:16351:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00000001:00080000:3.0:1785220002.677657:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:1.0:1785220002.677657:0:16351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785220002.677669:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:1.0:1785220002.677669:0:16351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785220002.677680:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:1.0:1785220002.677692:0:16351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.677700:0:16351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785220002.677705:0:16351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.677714:0:16351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.677735:0:16351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.677742:0:16351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220002.677846:0:16351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:2362:x1871938444193280:12345-192.168.203.31@tcp:4:dd.0 Request processed in 83157us (101743us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1785220002.677857:0:16351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 2 00000100:00100000:1.0:1785220002.677891:0:16351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:1.0:1785220002.677901:0:16351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+17:2362:x1871938444193408:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:1.0:1785220002.677936:0:16351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.677948:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.677958:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.677963:0:16351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.677974:0:16351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.731684:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785220002.731858:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465145472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785220002.731955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785220002.732148:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465145472 00000100:00100000:0.0:1785220002.732158:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465145472 00000100:00100000:0.0:1785220002.732224:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785220002.732235:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465145472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785220002.732266:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 62980096 pending 5111808 free 3859808256 avail 3856662528 00000100:00100000:0.0:1785220002.732331:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465145472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220002.732339:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785220002.732458:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1785220002.732465:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf381a28700, transno 8589934595 00000004:00080000:3.0:1785220002.732478:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1785220002.732513:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf348a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465145472:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1785220002.761282:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1785220002.761296:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:1.0:1785220002.761316:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761332:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761343:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761351:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf3489b0400 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785220002.761356:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761403:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761432:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761461:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1919dea/0x8b38d407a078de06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220002.761583:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+19:2362:x1871938444193024:12345-192.168.203.31@tcp:4:dd.0 Request processed in 174949us (185580us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1785220002.761595:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 0 00000100:00100000:1.0:1785220002.761637:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 4 00000100:00100000:1.0:1785220002.761651:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+18:2362:x1871938444193536:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:1.0:1785220002.761710:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761724:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.761729:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.761736:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.761751:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785220002.764810:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:2.0:1785220002.765158:0:16350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765176:0:16350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765187:0:16350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765195:0:16350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674000 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785220002.765201:0:16350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765212:0:16350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765238:0:16350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765246:0:16350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efe53472/0x8b38d407a078de0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.765353:0:16350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+13:2362:x1871938444193152:12345-192.168.203.31@tcp:4:dd.0 Request processed in 174303us (189285us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1785220002.765399:0:16350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 1 00000100:00100000:2.0:1785220002.765442:0:16350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:2.0:1785220002.765457:0:16350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+12:2362:x1871938444193664:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:2.0:1785220002.765519:0:16350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765534:0:16350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785220002.765539:0:16350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785220002.765547:0:16350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.765562:0:16350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785220002.875720:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1785220002.876168:0:16351:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1785220002.876173:0:16351:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1785220002.876188:0:16351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876201:0:16351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876211:0:16351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876220:0:16351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674600 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785220002.876225:0:16351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876234:0:16351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876269:0:16351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876276:0:16351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a47b0fa/0x8b38d407a078de1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.876425:0:16351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+15:2362:x1871938444193408:12345-192.168.203.31@tcp:4:dd.0 Request processed in 198521us (300186us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1785220002.876435:0:16351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 3 00000100:00100000:2.0:1785220002.876469:0:16351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 6 00000100:00100000:2.0:1785220002.876481:0:16351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+14:2362:x1871938444193792:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:2.0:1785220002.876511:0:16351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876524:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785220002.876528:0:16351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785220002.876534:0:16351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.876545:0:16351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785220002.947856:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1785220002.948563:0:16350:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1785220002.948569:0:16350:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1785220002.948583:0:16350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948596:0:16350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948618:0:16350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948627:0:16350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8e00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:1.0:1785220002.948632:0:16350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948642:0:16350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948661:0:16350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948669:0:16350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c865040c/0x8b38d407a078de29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785220002.948764:0:16350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+12:2362:x1871938444193664:12345-192.168.203.31@tcp:4:dd.0 Request processed in 183309us (359589us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1785220002.948775:0:16350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 5 00000100:00100000:1.0:1785220002.948808:0:16350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 7 00000100:00100000:1.0:1785220002.948819:0:16350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+11:2362:x1871938444193920:12345-192.168.203.31@tcp:4:dd.0 00010000:00010000:1.0:1785220002.948854:0:16350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948868:0:16350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.948880:0:16350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785220002.948887:0:16350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785220002.948899:0:16350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785220002.950521:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1785220002.950540:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.950565:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.950573:0:14861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.950580:0:14861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247675a00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785220002.950585:0:14861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.950594:0:14861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.950614:0:14861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.950622:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006062025f/0x8b38d407a078de22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220002.950689:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+11:2362:x1871938444193536:12345-192.168.203.31@tcp:4:dd.0 Request processed in 189040us (365061us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1785220002.950699:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 4 00000001:00080000:1.0:1785220002.980771:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1785220002.980987:0:16351:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:2.0:1785220002.981005:0:16351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.981037:0:16351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.981058:0:16351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.981066:0:16351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf37edc8800 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785220002.981071:0:16351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.981081:0:16351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.981101:0:16351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220002.981109:0:16351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000937c9aca/0x8b38d407a078de30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785220002.986068:0:16351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3506c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+9:2362:x1871938444193792:12345-192.168.203.31@tcp:4:dd.0 Request processed in 109578us (396317us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1785220002.986083:0:16351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 6 00000001:00080000:1.0:1785220003.058012:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1785220003.058295:0:16350:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1785220003.058311:0:16350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220003.058324:0:16350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220003.058348:0:16350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220003.058356:0:16350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf247674c00 already unused, calling callback (ffffffffc158d310) 00010000:00010000:2.0:1785220003.058361:0:16350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220003.058391:0:16350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220003.058488:0:16350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785220003.058495:0:16350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc5b3ce8/0x8b38d407a078de37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785220003.058592:0:16350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2362:x1871938444193920:12345-192.168.203.31@tcp:4:dd.0 Request processed in 109771us (468685us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1785220003.058602:0:16350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 7 00010000:00010000:3.0:1785220003.692970:0:15819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785220003.756223:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465145728:0@lo:400:kworker.0 00000100:00100000:2.0:1785220003.756300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785220003.756334:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465145600:0@lo:400:kworker.0 00000100:00100000:2.0:1785220003.756354:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465146240:0@lo:400:kworker.0 00000100:00100000:0.0:1785220003.756406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785220003.756412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785220003.756442:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465146112:0@lo:400:kworker.0 00000100:00100000:2.0:1785220003.756460:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465145856:0@lo:400:kworker.0 00000100:00100000:0.0:1785220003.756471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785220003.756507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785220003.756516:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465145728 00000100:00100000:0.0:1785220003.756524:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465145728 00000100:00100000:2.0:1785220003.756530:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785220003.756538:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf24762ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465145984:0@lo:400:kworker.0 00000100:00100000:2.0:1785220003.756559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785220003.756568:0:14855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465145856 00000100:00100000:0.0:1785220003.756573:0:14855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465145856 00000100:00100000:0.0:1785220003.756621:0:14855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785220003.756629:0:14855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465145728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785220003.756683:0:14855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871938465145728:12345-0@lo:400:kworker.0 Request processed in 54us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1785220003.756942:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465146240 00000100:00100000:1.0:1785220003.756947:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465146240 00000100:00100000:2.0:1785220003.756970:0:16347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785220003.756979:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465146112 00000100:00100000:2.0:1785220003.756983:0:16347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465145856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785220003.756985:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465146112 00000100:00100000:1.0:1785220003.757004:0:16345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465145984 00000100:00100000:1.0:1785220003.757008:0:16345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465145984 00000100:00100000:1.0:1785220003.757028:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785220003.757043:0:16347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465145856:12345-0@lo:400:kworker.0 Request processed in 55us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1785220003.757050:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465146240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785220003.757056:0:16347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785220003.757087:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785220003.757097:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465146112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785220003.757101:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871938465146240:12345-0@lo:400:kworker.0 Request processed in 64us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1785220003.757110:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785220003.757144:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871938465146112:12345-0@lo:400:kworker.0 Request processed in 50us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220003.757246:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465145600 00000100:00100000:3.0:1785220003.757250:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465145600 00000100:00100000:3.0:1785220003.757276:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1785220003.757282:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf34a9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:3306:x1871938465145600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785220003.757302:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785220003.757310:0:16345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf24762ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465145984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1785220003.757329:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785220003.757333:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785220003.757340:0:16345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf24762ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871938465145984:12345-0@lo:400:kworker.0 Request processed in 32us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220003.757356:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf34a9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19240113-729d-48ac-b4dd-0e1109961383+19:3306:x1871938465145600:12345-0@lo:400:kworker.0 Request processed in 75us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220003.757379:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1785220003.757858:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cf246f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465146368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785220003.757961:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785220003.758014:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938465146368 00000100:00100000:3.0:1785220003.758019:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938465146368 00000100:00100000:3.0:1785220003.758058:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785220003.758066:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf246f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465146368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785220003.758094:0:14858:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785220003.758129:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf246f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871938465146368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1785220003.758136:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785220003.758181:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf246f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465146368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785220003.758193:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871938465145984:0@lo:400:kworker.0 00000100:00100000:3.0:1785220003.758202:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1871938465145856:0@lo:400:kworker.0 00000100:00100000:3.0:1785220003.758236:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1871938465145728:0@lo:400:kworker.0 00000100:00100000:3.0:1785220003.758252:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1871938465146240:0@lo:400:kworker.0 00000100:00100000:3.0:1785220003.758930:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19240113-729d-48ac-b4dd-0e1109961383:3306:1871938465145600:0@lo:400:kworker.0 00000100:00100000:3.0:1785220003.758974:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cf24762ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1871938465146112:0@lo:400:kworker.0 00000100:00100000:0.0:1785220003.759281:0:14855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785220003.767311:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785220003.767603:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:0.0:1785220004.467653:0:14254:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1785220004.467669:0:14254:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785220004.467704:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1785220004.467712:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1785220004.717859:0:14208:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785220004.790540:0:16389:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1785220004.889143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220004.889188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220004.889214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220004.889234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220004.889254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220004.889271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220004.889292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.31@tcp (source: 12345-192.168.203.31@tcp) 00000100:00100000:0.0:1785220004.889314:0:16347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194432 00000100:00100000:0.0:1785220004.889323:0:16347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194432 00000100:00100000:0.0:1785220004.889394:0:16347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194944 00000100:00100000:0.0:1785220004.889398:0:16347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194944 00000100:00100000:0.0:1785220004.889413:0:16347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194560 00000100:00100000:0.0:1785220004.889415:0:16347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194560 00000100:00100000:0.0:1785220004.889428:0:16347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194816 00000100:00100000:0.0:1785220004.889430:0:16347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194816 00000100:00100000:0.0:1785220004.889445:0:16347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1785220004.889454:0:16347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444194432:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785220004.889526:0:16347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444194432:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220004.889533:0:16347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 16 00000100:00100000:0.0:1785220004.889550:0:16347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1785220004.889556:0:16347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444194944:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785220004.889581:0:16347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444194944:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220004.889586:0:16347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 17 00000100:00100000:0.0:1785220004.889607:0:16347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1785220004.889614:0:16347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444194560:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785220004.889638:0:16347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+5:2360:x1871938444194560:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220004.889643:0:16347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 18 00000100:00100000:0.0:1785220004.889653:0:16347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1785220004.889659:0:16347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444194816:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785220004.889681:0:16347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92b71284-157a-470c-8ec4-7c4d63f2d4c3+5:2360:x1871938444194816:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220004.889687:0:16347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 19 00000100:00100000:0.0:1785220004.889704:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194688 00000100:00100000:0.0:1785220004.889708:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194688 00000100:00100000:0.0:1785220004.889731:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194304 00000100:00100000:0.0:1785220004.889733:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194304 00000100:00100000:0.0:1785220004.889754:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1785220004.889760:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2360:x1871938444194688:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785220004.889788:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92b71284-157a-470c-8ec4-7c4d63f2d4c3+6:2360:x1871938444194688:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220004.889793:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 29 00000100:00100000:0.0:1785220004.889805:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00100000:0.0:1785220004.889810:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf348a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+20:2360:x1871938444194304:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:0.0:1785220004.889832:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf348a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22b52ba8-0ef2-43ea-b50a-dd369f8218e8+20:2360:x1871938444194304:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 22us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1785220004.889837:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 30 00000100:00080000:0.0:1785220004.889873:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785220004.889878:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785220004.889880:0:14215:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785220004.890156:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871938444194176 00000100:00100000:2.0:1785220004.890162:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871938444194176 00000100:00100000:2.0:1785220004.890198:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.31@tcp, seq: 123 00000100:00100000:2.0:1785220004.890205:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf3503dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:2360:x1871938444194176:12345-192.168.203.31@tcp:400:kworker.0 00000100:00100000:2.0:1785220004.890237:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf3503dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3b54294-9d7e-4b42-96a3-9a0e0422cfbc+13:2360:x1871938444194176:12345-192.168.203.31@tcp:400:kworker.0 Request processed in 33us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1785220004.890244:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.31@tcp, seq: 123 00010000:00010000:1.0:1785220005.740972:0:14207:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29300 lines, 29300 kept, 0 dropped, 0 bad.